Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

【Codon】With repeated processing, memory consumption increases, Killed is displayed, and processing stops. #551

Open
icst005 opened this issue Apr 3, 2024 · 2 comments

Comments

@icst005
Copy link

icst005 commented Apr 3, 2024

I was not sure if there was a report applicable to the same case, so I am reporting it just in case.

In the following environment and execution of the code in codon, the memory usage increases and the process becomes Killed and stops.
When executing the code in Python, there is no increase in memory usage and the process completes to the end.
("owari" is displayed.  「np07b = None」 is not working in codon?)

If you can get the Log by some means and need to provide it, please contact me.
I will try to help.

Windows 10 Pro
22H2
Windows Feature Experience Pack 1000.19055.1000.0

Core(TM) i7-7700HQ
memory:64GB

codon:v0.16

From Windowshell, execute the following command
「codon run -release test01.py」

-------------------- test01.py ------------------
import time
import datetime
from python import numpy as np
from python import pandas as pd
from python import random

def main(aa000):

t00 = time.time()

for aa001 in range(1000000): 

    np07b = np.zeros((99999, 1) , dtype = 'int32')
            
    np.random.seed()
    np07b[0: 99999, 0] = np.random.randint(0, 9, 99999)
  
    np07b = None
    
t01 = time.time()
t02 = t01 - t00
print(t02)
print("owari")
            

     
                
              
 #------------------------------------------------------------                           
 #------------------------------------------------------------ 

t00 = time.time()

for aa000 in range(1):

main(aa000)
@arshajii
Copy link
Contributor

arshajii commented Apr 9, 2024

Thanks for issue @icst005 -- we'll look into it. Creating Python objects in Codon allocates memory tracked by the GC, but the GC should be collecting the temporary objects so memory growth definitely shouldn't be unbounded.

@icst005
Copy link
Author

icst005 commented Apr 16, 2024

Thank you for your comment.

If there is anything else I need to provide, such as additional information, please do not hesitate to let me know.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants