Source systems
Source systems
Build typed, archetype-aware migration projects for warehouses, databases, ERP and SaaS applications, ETL platforms, mainframes, query engines, and streams.
Airlift source packs turn a source name into a developer contract. Variants, workload surfaces, specialist adapter boundaries, governed actions, required evidence, residue, and Databricks modernization targets. The pack never contains credentials and never equates catalog coverage with live certification.
npm install --global @fabricorg/airlift-cli
fa sources
fa source inspect sap
fa source plan sap --variant sap_s4hana
fa source plan kafka --variant confluent_cloud --jsonWarehouses and analytical platforms
| Source | Profile | Public level | Developer guide |
|---|---|---|---|
| Azure Synapse | synapse | executable | Synapse |
| SQL Server and Azure SQL | sql_server | executable | SQL Server |
| Snowflake | snowflake | executable | Snowflake |
| Amazon Redshift | redshift | executable | Redshift |
| Oracle | oracle | executable | Oracle |
| Teradata | teradata | executable | Teradata |
| Netezza | netezza | assessable | Netezza |
| Hadoop | hadoop | assessable | Hadoop |
| Google BigQuery | bigquery | assessable | BigQuery |
| Greenplum | greenplum | cataloged | Greenplum |
| Vertica | vertica | cataloged | Vertica |
The seven Databricks Migration & Modernization specialization tracks represented here are:
- Microsoft SQL Migration;
- Snowflake Migration;
- AWS Redshift Migration;
- Azure Synapse Migration;
- Oracle Migration;
- Hadoop Migration;
- Teradata Migration.
ERP, SaaS, and operational systems
| Source | Profile | Important variants | Guide |
|---|---|---|---|
| SAP | sap | BDC, S/4HANA, ECC, BW/4HANA, HANA, Datasphere | SAP |
| Microsoft Dynamics 365 | dynamics_365 | Dataverse, Finance and Operations, Sales and Service | Dynamics 365 |
| Salesforce | salesforce | Sales/Service Cloud, Marketing Cloud | Salesforce |
| PostgreSQL | postgresql | PostgreSQL, Aurora, RDS | PostgreSQL |
| MySQL | mysql | MySQL, Aurora, RDS, MariaDB | MySQL |
| Workday | workday | HCM, reports and extracts | Workday |
| ServiceNow | servicenow | ServiceNow platform | ServiceNow |
Already on Databricks
| Source | Profile | Modernization variants | Guide |
|---|---|---|---|
| Databricks native estate | databricks | Unity Catalog, workspace consolidation, cost/performance | Databricks-native modernization |
Pipelines, query engines, and streams
| Source | Profile | Route | Guide |
|---|---|---|---|
| Informatica, SSIS, ADF, Glue, Talend, Matillion, ODI | etl_modernization | pipeline export, mapping, implementation, rehearsal | ETL modernization |
| IBM Db2 and mainframe data | db2 | platform-aware unload or log capture | Db2 |
| Amazon Athena | athena | catalog-by-catalog federation or materialization | Athena |
| Presto | presto | backing-source disposition | Presto |
| Trino and Starburst | trino | backing-source disposition | Trino |
| Kafka, Confluent, Amazon MSK | kafka | checkpointed parallel run | Kafka |
| Azure Event Hubs | event_hubs | offsets, checkpoints, loss/duplicate proof | Event Hubs |
| Amazon Kinesis | kinesis | sequence checkpoints and parallel run | Kinesis |
Ten areas every source pack covers
SOURCE_MIGRATION_AREAS requires every plan to address:
- inventory and dependencies;
- SQL and code conversion or disposition;
- data movement;
- pipelines and orchestration;
- security and Unity Catalog governance;
- functional and data validation;
- performance and scale;
- BI and downstream consumers;
- cutover and rollback;
- Databricks modernization.
Use the registry from TypeScript
import {
createSourceMigrationPlan,
resolveSourceSystemProfile,
} from '@fabricorg/airlift';
const profile = resolveSourceSystemProfile('d365');
const plan = createSourceMigrationPlan(profile.id, {
variant: 'dynamics_365_finance_operations',
});
console.log(profile.archetype); // saas
console.log(profile.implementationRoutingLevel); // cataloged; routing breadth, not achieved proof
console.log(plan.steps.map((step) => step.id));Continue with the source-pack contract and developer workflow.