python - error trying to use GridSearhCV with XGBClassifier -


i trying use gridsearchcv xgboost in order train , fit using best prams quite large dataset (> 500mb). i'm getting error unable resolve. have laptop 32gb ram , python memory consumption did not exceed 10gb once left running don't think memory-related issue although not sure.

i not know if can through these kinds of errors using different model or else. maybe problem grid search not sure how on without using it.

here code:

parameters = {'learning_rate': [0.03,0.04,0.05,0.06,0.07],               'max_depth': [3,5,7,9,11],               'min_child_weight': [2,4,6,8,10],               'subsample': [0.9,0.8,0.7,0.6,0.5],               'colsample_bytree': [0.9,0.8,0.7,0.6,0.5]}  xgb_model = xgbclassifier(objective = 'multi:softprob', nthread = 4, n_estimators= 1000, seed = 1337, silent = 0)  clf = gridsearchcv(estimator=xgb_model,param_grid=parameters,n_jobs=-1,verbose = 5) clf.fit(orders_prior1[['user_id','order_number','order_dow','order_hour_of_day','days_since_prior_order']]\                        ,orders_prior1['product_id'], orders_prior1['user_order']) 

here error:

traceback (most recent call last):   file "c:\anaconda3\lib\site-packages\sklearn\externals\joblib\_parallel_backends.py", line 344, in __call__     return self.func(*args, **kwargs)   file "c:\anaconda3\lib\site-packages\sklearn\externals\joblib\parallel.py", line 131, in __call__     return [func(*args, **kwargs) func, args, kwargs in self.items]   file "c:\anaconda3\lib\site-packages\sklearn\externals\joblib\parallel.py", line 131, in <listcomp>     return [func(*args, **kwargs) func, args, kwargs in self.items]   file "c:\anaconda3\lib\site-packages\sklearn\model_selection\_validation.py", line 238, in _fit_and_score     estimator.fit(x_train, y_train, **fit_params)   file "c:\anaconda3\lib\site-packages\xgboost\sklearn.py", line 445, in fit     verbose_eval=verbose)   file "c:\anaconda3\lib\site-packages\xgboost\training.py", line 205, in train     xgb_model=xgb_model, callbacks=callbacks)   file "c:\anaconda3\lib\site-packages\xgboost\training.py", line 76, in _train_internal     bst.update(dtrain, i, obj)   file "c:\anaconda3\lib\site-packages\xgboost\core.py", line 806, in update     _check_call(_lib.xgboosterupdateoneiter(self.handle, iteration, dtrain.handle)) oserror: [winerror -529697949] windows error 0xe06d7363 

i posted quite similar question (except using neural network classifier) few days ago still, did not positive answer. ideas on why kind of error happens , how resolve kind of error? maybe try different language? although python became key language dealing data-science problems, using different language on problem. in advance.


Comments

Popular posts from this blog

ubuntu - PHP script to find files of certain extensions in a directory, returns populated array when run in browser, but empty array when run from terminal -

php - How can i create a user dashboard -

javascript - How to detect toggling of the fullscreen-toolbar in jQuery Mobile? -