Source systems
Source systems
Build typed, archetype-aware migration projects for warehouses, databases, ERP and SaaS applications, ETL platforms, mainframes, query engines, and streams.
Source systems
Airlift source packs turn a source name into a developer contract: variants, workload surfaces, specialist adapter boundaries, governed actions, required evidence, residue, and Databricks modernization targets. The pack never contains credentials and never equates catalog coverage with live certification.
npm install --global @fabricorg/airlift-cli
fa sources
fa source inspect sap
fa source plan sap --variant sap_s4hana
fa source plan kafka --variant confluent_cloud --jsonWarehouses and analytical platforms
| Source | Profile | Public level | Developer guide |
|---|---|---|---|
| Azure Synapse | synapse | executable | Synapse |
| SQL Server and Azure SQL | sql_server | executable | SQL Server |
| Snowflake | snowflake | executable | Snowflake |
| Amazon Redshift | redshift | executable | Redshift |
| Oracle | oracle | executable | Oracle |
| Teradata | teradata | executable | Teradata |
| Netezza | netezza | assessable | Netezza |
| Hadoop | hadoop | assessable | Hadoop |
| Google BigQuery | bigquery | assessable | BigQuery |
| Greenplum | greenplum | cataloged | Greenplum |
| Vertica | vertica | cataloged | Vertica |
The seven Databricks Migration & Modernization specialization tracks represented here are:
- Microsoft SQL Migration;
- Snowflake Migration;
- AWS Redshift Migration;
- Azure Synapse Migration;
- Oracle Migration;
- Hadoop Migration;
- Teradata Migration.
ERP, SaaS, and operational systems
| Source | Profile | Important variants | Guide |
|---|---|---|---|
| SAP | sap | BDC, S/4HANA, ECC, BW/4HANA, HANA, Datasphere | SAP |
| Microsoft Dynamics 365 | dynamics_365 | Dataverse, Finance and Operations, Sales and Service | Dynamics 365 |
| Salesforce | salesforce | Sales/Service Cloud, Marketing Cloud | Salesforce |
| PostgreSQL | postgresql | PostgreSQL, Aurora, RDS | PostgreSQL |
| MySQL | mysql | MySQL, Aurora, RDS, MariaDB | MySQL |
| Workday | workday | HCM, reports and extracts | Workday |
| ServiceNow | servicenow | ServiceNow platform | ServiceNow |
Already on Databricks
| Source | Profile | Modernization variants | Guide |
|---|---|---|---|
| Databricks native estate | databricks | Unity Catalog, workspace consolidation, cost/performance | Databricks-native modernization |
Pipelines, query engines, and streams
| Source | Profile | Route | Guide |
|---|---|---|---|
| Informatica, SSIS, ADF, Glue, Talend, Matillion, ODI | etl_modernization | pipeline export, mapping, implementation, rehearsal | ETL modernization |
| IBM Db2 and mainframe data | db2 | platform-aware unload or log capture | Db2 |
| Amazon Athena | athena | catalog-by-catalog federation or materialization | Athena |
| Presto | presto | backing-source disposition | Presto |
| Trino and Starburst | trino | backing-source disposition | Trino |
| Kafka, Confluent, Amazon MSK | kafka | checkpointed parallel run | Kafka |
| Azure Event Hubs | event_hubs | offsets, checkpoints, loss/duplicate proof | Event Hubs |
| Amazon Kinesis | kinesis | sequence checkpoints and parallel run | Kinesis |
Ten areas every source pack covers
SOURCE_MIGRATION_AREAS requires every plan to address:
- inventory and dependencies;
- SQL and code conversion or disposition;
- data movement;
- pipelines and orchestration;
- security and Unity Catalog governance;
- functional and data validation;
- performance and scale;
- BI and downstream consumers;
- cutover and rollback;
- Databricks modernization.
Use the registry from TypeScript
import {
createSourceMigrationPlan,
resolveSourceSystemProfile,
} from '@fabricorg/airlift';
const profile = resolveSourceSystemProfile('d365');
const plan = createSourceMigrationPlan(profile.id, {
variant: 'dynamics_365_finance_operations',
});
console.log(profile.archetype); // saas
console.log(profile.implementationRoutingLevel); // cataloged; routing breadth, not achieved proof
console.log(plan.steps.map((step) => step.id));Continue with the source-pack contract and developer workflow.