dify/api
Ademílson Tonato 6024d8a42d
refactor: Update Firecrawl to use v1 API (#12574)
Co-authored-by: Ademílson Tonato <ademilson.tonato@refurbed.com>
2025-01-23 11:14:48 +08:00
..
.idea fix nltk averaged_perceptron_tagger download and fix score limit is none (#7582) 2024-08-26 15:14:05 +08:00
.vscode feat/enhance the multi-modal support (#8818) 2024-10-21 10:43:49 +08:00
configs chore: update version to 0.15.2 in packaging and docker configurations (#12940) 2025-01-22 16:40:44 +08:00
constants feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
contexts feat/enhance the multi-modal support (#8818) 2024-10-21 10:43:49 +08:00
controllers add milvus full text search setting (#12930) 2025-01-22 13:36:39 +08:00
core refactor: Update Firecrawl to use v1 API (#12574) 2025-01-23 11:14:48 +08:00
docker refactor: enhance API token validation with session locking and last used timestamp update (#12426) 2025-01-07 18:04:41 +08:00
events chore(lint): fix quotes for f-string formatting by bumping ruff to 0.9.x (#12702) 2025-01-21 10:12:29 +08:00
extensions fix: utcfromtimestamp is Deprecated change to new api (#12120) 2025-01-02 18:52:36 +08:00
factories fix: allow fallback to remote_url when url is not provided (#12455) 2025-01-07 22:33:25 +08:00
fields feat: Add ability to change profile avatar (#12642) 2025-01-22 10:11:31 +08:00
libs feat: Add ability to change profile avatar (#12642) 2025-01-22 10:11:31 +08:00
migrations fix(models): use bigint on workflow_runs.total_tokens (#12279) 2025-01-02 09:49:34 +08:00
models fix(batch_create_segment_to_index_task): count max_position in memory. (#12929) 2025-01-22 13:39:02 +08:00
schedule sandbox doesn't provide auto disable log (#12388) 2025-01-06 15:57:13 +08:00
services refactor: Update Firecrawl to use v1 API (#12574) 2025-01-23 11:14:48 +08:00
tasks fix(batch_create_segment_to_index_task): count max_position in memory. (#12929) 2025-01-22 13:39:02 +08:00
templates feat: account delete (#11829) 2024-12-30 11:33:42 +08:00
tests refactor: Update Firecrawl to use v1 API (#12574) 2025-01-23 11:14:48 +08:00
.dockerignore build: support Poetry for depencencies tool in api's Dockerfile (#5105) 2024-06-22 01:34:08 +08:00
.env.example feat: support configuration of refresh token expiration by environment variable (#12335) 2025-01-04 11:56:44 +08:00
.ruff.toml chore(lint): fix quotes for f-string formatting by bumping ruff to 0.9.x (#12702) 2025-01-21 10:12:29 +08:00
app_factory.py feat: full support for opendal and sync configurations between .env and docker-compose (#11754) 2024-12-18 09:05:54 +08:00
app.py fix(app.py): if condition (#12314) 2025-01-03 01:36:23 +08:00
commands.py py lint (#12102) 2024-12-26 00:16:35 +08:00
dify_app.py refactor: assembling the app features in modular way (#9129) 2024-11-30 23:05:22 +08:00
Dockerfile chore(build): bump poetry from 1.x to 2.x (#12369) 2025-01-22 13:38:24 +08:00
mypy.ini feat: mypy for all type check (#10921) 2024-12-24 18:38:51 +08:00
poetry.lock chore(build): bump poetry from 1.x to 2.x (#12369) 2025-01-22 13:38:24 +08:00
poetry.toml build: initial support for poetry build tool (#4513) 2024-06-11 13:11:28 +08:00
pyproject.toml chore(build): bump poetry from 1.x to 2.x (#12369) 2025-01-22 13:38:24 +08:00
pytest.ini feat: Add support for TEI API key authentication (#11006) 2024-11-23 23:55:35 +08:00
README.md chore(build): bump poetry from 1.x to 2.x (#12369) 2025-01-22 13:38:24 +08:00

Dify Backend API

Usage

Important

In the v0.6.12 release, we deprecated pip as the package management tool for Dify API Backend service and replaced it with poetry.

  1. Start the docker-compose stack

    The backend require some middleware, including PostgreSQL, Redis, and Weaviate, which can be started together using docker-compose.

    cd ../docker
    cp middleware.env.example middleware.env
    # change the profile to other vector database if you are not using weaviate
    docker compose -f docker-compose.middleware.yaml --profile weaviate -p dify up -d
    cd ../api
    
  2. Copy .env.example to .env

    cp .env.example .env 
    
  3. Generate a SECRET_KEY in the .env file.

    bash for Linux

    sed -i "/^SECRET_KEY=/c\SECRET_KEY=$(openssl rand -base64 42)" .env
    

    bash for Mac

    secret_key=$(openssl rand -base64 42)
    sed -i '' "/^SECRET_KEY=/c\\
    SECRET_KEY=${secret_key}" .env
    
  4. Create environment.

    Dify API service uses Poetry to manage dependencies. You can execute poetry shell to activate the environment.

  5. Install dependencies

    poetry env use 3.12
    poetry install
    
  6. Run migrate

    Before the first launch, migrate the database to the latest version.

    poetry run python -m flask db upgrade
    
  7. Start backend

    poetry run python -m flask run --host 0.0.0.0 --port=5001 --debug
    
  8. Start Dify web service.

  9. Setup your application by visiting http://localhost:3000...

  10. If you need to handle and debug the async tasks (e.g. dataset importing and documents indexing), please start the worker service.

poetry run python -m celery -A app.celery worker -P gevent -c 1 --loglevel INFO -Q dataset,generation,mail,ops_trace,app_deletion

Testing

  1. Install dependencies for both the backend and the test environment

    poetry install -C api --with dev
    
  2. Run the tests locally with mocked system environment variables in tool.pytest_env section in pyproject.toml

    poetry run -P api bash dev/pytest/pytest_all_tests.sh