ASP.net C# VB.Net PHP
Swoole ASP/ADO/VBScript SQL语言 Python Python3 Diango C语言 Lua C++ Go语言 Revel Docker Ruby Perl Erlang R语言 Julia Apex OAuth 2.0 Arduino 编程经验 汇编语言 树莓派 游戏设计 MATLAB Elasticsearch Numpy F# Delphi HTCondor Rust 易语言 NSQ
用户登录
用户注册

分享至

分析 python 多处理池

  • 作者: 女暧男
  • 来源: 51数据库
  • 2022-12-12

问题描述

我正在尝试在多处理池中的每个进程上运行 cProfile.runctx()，以了解我的源中的多处理瓶颈是什么.这是我正在尝试做的一个简化示例:

I'm trying to run cProfile.runctx() on each process in a multiprocessing pool, to get an idea of what the multiprocessing bottlenecks are in my source. Here is a simplified example of what I'm trying to do:

from multiprocessing import Pool
import cProfile

def square(i):
    return i*i

def square_wrapper(i):
    cProfile.runctx("result = square(i)",
        globals(), locals(), "file_"+str(i))
    # NameError happens here - 'result' is not defined.
    return result

if __name__ == "__main__":
    pool = Pool(8)
    results = pool.map_async(square_wrapper, range(15)).get(99999)
    print results

不幸的是，尝试在分析器中执行result = square(i)"不会影响调用范围内的result".我怎样才能在这里完成我想要做的事情?

Unfortunately, trying to execute "result = square(i)" in the profiler does not affect 'result' in the scope it was called from. How can I accomplish what I am trying to do here?

推荐答案

试试这个:

def square_wrapper(i):
    result = [None]
    cProfile.runctx("result[0] = square(i)", globals(), locals(), "file_%d" % i)
    return result[0]
推荐阅读
热点文章

Copyright 2018 51数据库(www.51sjk.com)

软件
前端设计
程序设计
Java相关