this post was submitted on 18 Jun 2022
1 points (100.0% liked)

Python

3167 readers
1 users here now

News and discussions about the programming language Python

founded 5 years ago
MODERATORS
MinutePhrase@lemmy.ml
1
looking for a fast multi process shared dict (feddit.de)
submitted 2 years ago by sexy_peach@feddit.de to c/python@lemmy.ml
0 comments fedilink hide all child comments
 

cross-posted from: https://feddit.de/post/248196

I have lots of multiprocessing processes which have to add to and search in a dict. Deletion of values is not needed.

Atm I am using multiprocessing.Manager() and

dict = manager.dict()

This works pretty well, but I think that the manager is a huge bottleneck here. Any ideas? It has to run on older Python 3 versions, otherwise I would use this cool thing I found: https://github.com/ronny-rentner/UltraDict

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here