Add OpenAI-like service

[denisshepelin]

Following the Gemini and Claude service I propose the simple interface to OpenAI-compatible endpoints.

I've checked it with Openrouter and gpt-4o-mini, seems to work fine.

It has tracking of tokens and API call counts.

[github-actions]

CLA Assistant Lite bot All contributors have signed the CLA ✍️ ✅

[denisshepelin]

I have read the CLA document and I hereby sign the CLA

[VikParuchuri]

Thanks for the contribution! This looks great, but I will need to find some time to test it before merging

[scottydelta]

@denisshepelin I tried this PR, getting this error:

Error code: 401 - {'error': {'message': 'No auth credentials found', 'code': 401}}
Error code: 401 - {'error': {'message': 'No auth credentials found', 'code': 401}}
Error code: 401 - {'error': {'message': 'No auth credentials found', 'code': 401}}
Error code: 401 - {'error': {'message': 'No auth credentials found', 'code': 401}}
Error code: 401 - {'error': {'message': 'No auth credentials found', 'code': 401}}

Here is the config:

config = {
        "output_format": "markdown",
        "output_dir": folder_path,
        "use_llm": True,
        "llm_service": "marker.services.openai.OpenAIService",
        "openai_key": "KEY_HERE",
    }

code used to install this branch:

pip install git+https://github.com/denisshepelin/marker@openai_like_service

[denisshepelin]

@scottydelta you will also need to provide a openai_base_url="https://api.openai.com/v1" if it's openai model and openai_model="gpt-4o-mini" .

My idea was to create a OpenAI-compatible interface where people can use any model that supports pythons openai module (like Grok or Gemini with experimental OpenAI support)