Skip to content

/ flinkStreamSQL

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sink-HDFS支持 #348

Open
easonliu30624700 opened this issue Aug 21, 2020 · 3 comments
Open

Sink-HDFS支持 #348

easonliu30624700 opened this issue Aug 21, 2020 · 3 comments

Comments

@easonliu30624700
Copy link

@easonliu30624700 easonliu30624700 commented Aug 21, 2020

sink端是否考虑支持写入hdfs文件？
@deadwind4
Copy link
Contributor

@deadwind4 deadwind4 commented Aug 21, 2020

您是什么场景下有这种需求，可以再详细描述下。
@easonliu30624700
Copy link
Author

@easonliu30624700 easonliu30624700 commented Aug 24, 2020

@deadwind4 每分钟的窗口统计，结果会落地到hdfs。另外有小时级别的离线任务进行汇总，以及离线仓库hive那边也会用到数据。再者，任务运行过程中的脏数据，也要存储到hdfs。
@easonliu30624700
Copy link
Author

@easonliu30624700 easonliu30624700 commented Aug 24, 2020

@deadwind4 你们可以考虑是否有支持的必要。我这边会自己实现一个。
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
@deadwind4 @easonliu30624700
You can’t perform that action at this time.