Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions docs/html/_sources/airflow-intro.md.txt
Original file line number Diff line number Diff line change
Expand Up @@ -125,7 +125,7 @@ run_this = PythonOperator(

### Airflow
- Airbnb data team
- Open-sourced mud 2015
- Open-sourced mid 2015
- Apache incubator mid-2016
- ETL pipelines

Expand All @@ -151,4 +151,4 @@ run_this = PythonOperator(
| Task are defined by`dag_id` defined by user name | Task are defined by task name and parameters |
| Task retries based on definitions | Decide if a task is done via input/output |
| Task code to the worker | Workers started by Python file where the tasks are defined |
| Centralized scheduler (Celery spins up workers) | Centralized scheduler in charge of deduplication sending tasks (Tornado based) |
| Centralized scheduler (Celery spins up workers) | Centralized scheduler in charge of deduplication sending tasks (Tornado based) |