You now understand data ingestion:
- Batch handles most workloads; stream where latency matters
- ELT is the modern standard, transforming in the warehouse
- CDC captures changes efficiently using database logs
- Managed tools like Fivetran reduce maintenance burden
- Custom connectors need rate limiting, incremental loads, and error handling
In interviews, discuss tradeoffs. Don't just say "use Fivetran." Explain when managed tools make sense and when custom solutions are worth the investment.