Skip to content

kMS MemoryError #7

Description

@viralp

Hi,

I am getting the following error while using kMS.py on MeerKAT data on Rhodes ike server.

===================] 100% - Make model grids........... 132/132 [==================================================] 100% - 8'08"

  • 12:53:32 - AsyncProcessPool | Make model grids: 132 jobs complete, average single-core time 28.97s per job
  • 12:53:39 - ClassImageSM | Make the solution-directions to gridmachine mapping
  • 14:36:06 - ClassImageSM | There are 4 non-zero directions
  • 14:37:27 - ClassWeighting | Weighting in Briggs mode
  • 14:37:28 - ClassWeighting | Calculating imaging weights with Robust=0.0 on an [477,477] grid
  • 14:41:52 - ClassVisServer | Min weight is 0.000000 max is 4.244273
  • 14:42:17 - ClassVisServer | Reading next data chunk in [ 0.00, 3.86] hours (column CORRECTED_DATA)
  • 14:45:09 - ClassMS | Data has only two polarisation, adapting shape
  • 14:45:09 - killMS | Traceback (most recent call last):
    File "/vault-ike/parekh/killMS/killMS/kMS.py", line 1197, in
    main(OP=OP,MSName=MSName)
    File "/vault-ike/parekh/killMS/killMS/kMS.py", line 628, in main
    Load=VS.LoadNextVisChunk()
    File "/vault-ike/parekh/killMS/killMS/Data/ClassVisServer.py", line 524, in LoadNextVisChunk
    self.DATA_CHUNK=MS.ReadData(t0=self.TimesInt[iT0],t1=self.TimesInt[iT1],ReadWeight=True)
    File "/vault-ike/parekh/killMS/killMS/Data/ClassMS.py", line 547, in ReadData
    data=np.zeros((nrow,nch,4),self.data.dtype)
    MemoryError

Traceback (most recent call last):
File "/vault-ike/parekh/stimela/bin/kMS.py", line 7, in
exec(compile(f.read(), file, 'exec'))
File "/vault-ike/parekh/killMS/killMS/kMS.py", line 1197, in
main(OP=OP,MSName=MSName)
File "/vault-ike/parekh/killMS/killMS/kMS.py", line 628, in main
Load=VS.LoadNextVisChunk()
File "/vault-ike/parekh/killMS/killMS/Data/ClassVisServer.py", line 524, in LoadNextVisChunk
self.DATA_CHUNK=MS.ReadData(t0=self.TimesInt[iT0],t1=self.TimesInt[iT1],ReadWeight=True)
File "/vault-ike/parekh/killMS/killMS/Data/ClassMS.py", line 547, in ReadData
data=np.zeros((nrow,nch,4),self.data.dtype)
MemoryError

/vault-ike/parekh/killMS/killMS/Data/ClassMS.py(547)ReadData()
-> data=np.zeros((nrow,nch,4),self.data.dtype)

Thanks

Cheers,
Viral

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions