TechFabricTechFabricAirlift
Source systems

Source systems

Build typed, archetype-aware migration projects for warehouses, databases, ERP and SaaS applications, ETL platforms, mainframes, query engines, and streams.

Airlift source packs turn a source name into a developer contract. Variants, workload surfaces, specialist adapter boundaries, governed actions, required evidence, residue, and Databricks modernization targets. The pack never contains credentials and never equates catalog coverage with live certification.

npm install --global @fabricorg/airlift-cli
fa sources
fa source inspect sap
fa source plan sap --variant sap_s4hana
fa source plan kafka --variant confluent_cloud --json

Warehouses and analytical platforms

SourceProfilePublic levelDeveloper guide
Azure SynapsesynapseexecutableSynapse
SQL Server and Azure SQLsql_serverexecutableSQL Server
SnowflakesnowflakeexecutableSnowflake
Amazon RedshiftredshiftexecutableRedshift
OracleoracleexecutableOracle
TeradatateradataexecutableTeradata
NetezzanetezzaassessableNetezza
HadoophadoopassessableHadoop
Google BigQuerybigqueryassessableBigQuery
GreenplumgreenplumcatalogedGreenplum
VerticaverticacatalogedVertica

The seven Databricks Migration & Modernization specialization tracks represented here are:

  • Microsoft SQL Migration;
  • Snowflake Migration;
  • AWS Redshift Migration;
  • Azure Synapse Migration;
  • Oracle Migration;
  • Hadoop Migration;
  • Teradata Migration.

ERP, SaaS, and operational systems

SourceProfileImportant variantsGuide
SAPsapBDC, S/4HANA, ECC, BW/4HANA, HANA, DatasphereSAP
Microsoft Dynamics 365dynamics_365Dataverse, Finance and Operations, Sales and ServiceDynamics 365
SalesforcesalesforceSales/Service Cloud, Marketing CloudSalesforce
PostgreSQLpostgresqlPostgreSQL, Aurora, RDSPostgreSQL
MySQLmysqlMySQL, Aurora, RDS, MariaDBMySQL
WorkdayworkdayHCM, reports and extractsWorkday
ServiceNowservicenowServiceNow platformServiceNow

Already on Databricks

SourceProfileModernization variantsGuide
Databricks native estatedatabricksUnity Catalog, workspace consolidation, cost/performanceDatabricks-native modernization

Pipelines, query engines, and streams

SourceProfileRouteGuide
Informatica, SSIS, ADF, Glue, Talend, Matillion, ODIetl_modernizationpipeline export, mapping, implementation, rehearsalETL modernization
IBM Db2 and mainframe datadb2platform-aware unload or log captureDb2
Amazon Athenaathenacatalog-by-catalog federation or materializationAthena
Prestoprestobacking-source dispositionPresto
Trino and Starbursttrinobacking-source dispositionTrino
Kafka, Confluent, Amazon MSKkafkacheckpointed parallel runKafka
Azure Event Hubsevent_hubsoffsets, checkpoints, loss/duplicate proofEvent Hubs
Amazon Kinesiskinesissequence checkpoints and parallel runKinesis

Ten areas every source pack covers

SOURCE_MIGRATION_AREAS requires every plan to address:

  • inventory and dependencies;
  • SQL and code conversion or disposition;
  • data movement;
  • pipelines and orchestration;
  • security and Unity Catalog governance;
  • functional and data validation;
  • performance and scale;
  • BI and downstream consumers;
  • cutover and rollback;
  • Databricks modernization.

Use the registry from TypeScript

import {
  createSourceMigrationPlan,
  resolveSourceSystemProfile,
} from '@fabricorg/airlift';

const profile = resolveSourceSystemProfile('d365');
const plan = createSourceMigrationPlan(profile.id, {
  variant: 'dynamics_365_finance_operations',
});

console.log(profile.archetype);    // saas
console.log(profile.implementationRoutingLevel); // cataloged; routing breadth, not achieved proof
console.log(plan.steps.map((step) => step.id));

Continue with the source-pack contract and developer workflow.

On this page