我在多处理设置中使用 Redis 作为生产者/消费者关系的队列.
I am using Redis as my queue for a producer/consumer relationship in a multiprocessing setup.
我的问题是我的生产者超载了我的消费者,然后窃取了它的 CPU.
My problem is that my producers are overloading my consumer then stealing it's CPU.
我的问题是,我能否在此设置中将整个处理器分配给特定的功能/进程(即消费者).
My question, can I allocate an entire processor to specific function/process (IE: the consumer) in this setup.
这不是 Python 开箱即用的东西.也有点特定于操作系统.在 Linux 下查看此答案:https://stackoverflow.com/a/9079117/4822566
It's not something Python does out of the box. Is also somewhat OS-specific. See this answer on doing under Linux: https://stackoverflow.com/a/9079117/4822566
这篇关于为进程指定特定的 CPU - python 多处理的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持html5模板网!
Python 多处理模块的 .join() 方法到底在做什么?What exactly is Python multiprocessing Module#39;s .join() Method Doing?(Python 多处理模块的 .join() 方法到底在做什么?)
在 Python 中将多个参数传递给 pool.map() 函数Passing multiple parameters to pool.map() function in Python(在 Python 中将多个参数传递给 pool.map() 函数)
multiprocessing.pool.MaybeEncodingError: 'TypeError("multiprocessing.pool.MaybeEncodingError: #39;TypeError(quot;cannot serialize #39;_io.BufferedReader#39; objectquot;,)#39;(multiprocessing.pool.MaybeEnc
Python 多进程池.当其中一个工作进程确定不再需要Python Multiprocess Pool. How to exit the script when one of the worker process determines no more work needs to be done?(Python 多进程池.当其中一
如何将队列引用传递给 pool.map_async() 管理的函数How do you pass a Queue reference to a function managed by pool.map_async()?(如何将队列引用传递给 pool.map_async() 管理的函数?)
与多处理错误的另一个混淆,“模块"对象没yet another confusion with multiprocessing error, #39;module#39; object has no attribute #39;f#39;(与多处理错误的另一个混淆,“模块对象