Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请问Task的父亲依赖节点DependOn的最大数量是多少? #42

Open
etherealiy opened this issue Oct 17, 2023 · 5 comments
Open

Comments

@etherealiy
Copy link

RT,测试了某个dag中某个Task的DependOn的长度为10000,即前向依赖于10000个任务节点,每个任务节点的Action是简单的print,但是执行到该节点(timeout设置为3600)时就卡住了,该task的状态一直维持为init。

@ShiningRush
Copy link
Owner

代码设计中其实没有数量限制,fastflow会事前在内存中构建一个Dag树,Task执行时会检查DependOn列表中这些前置Task的状态,如果都通过了才能执行。
如果你的Task一直为init,有没有检查过它的父任务是否都成功了呢

@etherealiy
Copy link
Author

我的图中有且只有一个终止节点(图的最大深度为13,最大宽度为1000),终止节点的状态为success,然而dagIns的状态一直维持在running,是因为图比较大,一直卡在dfsWalk吗?

@ShiningRush
Copy link
Owner

内存的walk是很快的,不应该卡这么久才对,要么是前置节点没完成,要么是有预期外的bug,这个是必现的吗

@etherealiy
Copy link
Author

我看mongodb中所有节点的状态都为success了。这是bug吗,或者是否会跟workercnt(parser)的数量设置有关?

@ShiningRush
Copy link
Owner

我看mongodb中所有节点的状态都为success了。这是bug吗,或者是否会跟workercnt(parser)的数量设置有关?

如果状态跟你描述的一样的话,它应该是个bug,如果是必现的话,我可以在本地复现看看

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants