The "Fivetran Connector SDK: Technical Enablement and Hands-on Lab" training introduces how to build custom data connectors using Python, enabling the automation of data movement to Fivetran's secure cloud environment. Participants will learn to create connections for any source, leverage proprietary APIs, augment native connectors, or extract specific datasets.

The SDK offers managed service benefits, including data writing, retries, schema inference, failure recovery, and robust security and compliance features. This is ideal for data extraction from proprietary or unsupported data sources, allowing data engineers to ingest data for analytics without relying on DevOps. The training differentiates the Connector SDK from Cloud Functions and Lite Connectors, emphasizing its customer-controlled release cycle and Fivetran-hosted solution. It covers the three-step process of installing the SDK, building connector code in Python with local testing, and deploying using simple CLI commands. Additionally, the module explores the SDK environment, best practices, CLI commands, key imports and methods, and effective debugging and monitoring.

This module also includes a practical, hands-on exercise where participants configure and set up a connector using the SDK, starting with sample code and progressing to building a connector from scratch using the News API.

Resources Provided by Fivetran

• Fivetran Account
• NewsAPI Data Source
• Snowflake Destination
• Sample Code

Prerequisites‍

• Python 3.11.6+ installation
• Basic Python knowledge
• Code Editor (VS Code, Sublime, Notepad++, etc)
• Web Browser (Chrome, Firefox, Edge, etc)
• Optional
  
  • SQL Workbench (DBeaver, etc)
  • DuckDB CLI