Broadcom

Broadcom AutoSys → Apache Airflow

Convert AutoSys JIL definitions, job streams, and box jobs to Apache Airflow DAGs.

Broadcom AutoSys (formerly CA Workload Automation AE) uses JIL (Job Information Language) to define jobs, boxes, and dependencies. BatchFoundry parses JIL definitions and converts them into Airflow DAGs, mapping AutoSys boxes to TaskGroups, conditions to task dependencies, and global variables to Airflow Variables or templated parameters.

Concept Mapping

JIL job definitionTask / Operator
Box jobTaskGroup / sub-DAG
condition (success/failure)TriggerRule
start_times / date_conditionsschedule_interval / timetable
alarm_if_failon_failure_callback / email_on_failure
max_run_alarmexecution_timeout
global variable ($$VAR)Airflow Variable / Param
machine attributequeue / pool
on_autoholdDAG paused state
autorep outputAirflow task log

The Hard Parts We Handle

  • JIL parsing for large, multi-file job catalogs
  • Box nesting → TaskGroup hierarchy
  • AutoSys global and local variable resolution
  • Cross-machine job dependencies → Airflow ExternalTaskSensor
  • Real-time calendar and holiday definitions
  • AutoSys event rules → Airflow triggers

JIL box job to DAG

Before

/* AutoSys JIL */
insert_job: DAILY_ETL  job_type: BOX
start_times: "01:00"
days_of_week: mo,tu,we,th,fr

insert_job: EXTRACT  job_type: CMD
box_name: DAILY_ETL
command: /opt/etl/extract.sh
condition: success(DAILY_ETL)

insert_job: LOAD  job_type: CMD
box_name: DAILY_ETL
command: /opt/etl/load.sh
condition: success(EXTRACT)

After (Airflow)

# Apache Airflow DAG
from airflow.decorators import dag, task_group
from airflow.operators.bash import BashOperator
from pendulum import datetime

@dag(schedule="0 1 * * 1-5", start_date=datetime(2025,1,1), catchup=False)
def daily_etl():
    @task_group()
    def etl_group():
        extract = BashOperator(task_id="extract", bash_command="/opt/etl/extract.sh")
        load = BashOperator(task_id="load", bash_command="/opt/etl/load.sh")
        extract >> load
    etl_group()

daily_etl()

Ready to migrate from Broadcom AutoSys?

Talk to a BatchFoundry engineer about your workload estate.

Talk to an Engineer

Related Migrations