Enable Streaming from SFTP to GCS in `SFTPToGCSOperator`
The current SFTPToGCSOperator in Airflow does not support streaming objects directly from SFTP to Google Cloud Storage (GCS). This design poses a challenge since both Composer and Airflow best practices recommend against assigning large amounts of memory to workers. Transferring sizeable files from SFTP to GCS without…
标题与摘要为来源原文(英文),暂无官方中文版本。
apache/airflow
继续探索
同方向条目
PhD GenAI Research Scientist Intern
Databricks 在San Francisco, California开放的学生岗位;职责、年级与工作许可要求以官方职位描述为准。
Software Engineering Intern (2027 Start) - Winter
Databricks 在Bellevue, Washington; Mountain View, California; San Francisco, California开放的学生岗位;职责、年级与工作许可要求以官方职位描述为准。
Product Management Intern (Summer 2027)
Databricks 在Bellevue, Washington; Mountain View, California; San Francisco, California开放的学生岗位;职责、年级与工作许可要求以官方职位描述为准。
Associate Product Manager, New Grad (2027 Start)
Databricks 在Bellevue, Washington; Mountain View, California; San Francisco, California开放的学生岗位;职责、年级与工作许可要求以官方职位描述为准。