Python crash on large data set

Hello

I wrote simple script to assign hourly weather data (only some hours were recorded) to hours. If there was no measurement it should return 0. It should work like this (example with similar values):

leadList = [501,502,503,504,505,506]
patternList = [502,503,506]
editList = [wData1,wData2,wData3]
finList = []

def assignData(i,y):
for i < len(leadList):
if leadList[i] == patternList[y]:
finList.append(editList[y])
i += 1
y += 1
else:
finList.append(0)
i += 1
assignData(i,y)

i = 0
y = 0
assignData(i,y)

which returns

[0,wData1,wData2,0,0,wData3]

My record has about 43000 values and RhinoWIP crashes every time I try to evaluate the whole list. But it works perfectly for smaller parts of my list. Can someone help me, please?

Attachments:

assignData.gh, 646 KB

Replies to This Discussion

Permalink Reply by Mostapha Sadeghipour Roudsari on August 2, 2017 at 6:21am

Recursive functions are memory intensive. For what you're trying to do you can use other solutions. Here is an example:

from collections import defaultdict
from itertools import izip

leadList = [501, 502, 503, 504, 505, 506]
patternList = [502, 503, 506]
editList = ['wData1', 'wData2', 'wData3']

d = defaultdict(int) # default value of int is 0

# assign the availabe values
for k, v in izip(patternList, editList):
d[k] = v

# get the final list
finList = [d[i] for i in leadList]

print finList
# [0, 'wData1', 'wData2', 0, 0, 'wData3']

Permalink Reply by Petr Vacek on August 2, 2017 at 6:30am