python - error trying to use GridSearhCV with XGBClassifier -
i trying use gridsearchcv xgboost in order train , fit using best prams quite large dataset (> 500mb). i'm getting error unable resolve. have laptop 32gb ram , python memory consumption did not exceed 10gb once left running don't think memory-related issue although not sure.
i not know if can through these kinds of errors using different model or else. maybe problem grid search not sure how on without using it.
here code:
parameters = {'learning_rate': [0.03,0.04,0.05,0.06,0.07], 'max_depth': [3,5,7,9,11], 'min_child_weight': [2,4,6,8,10], 'subsample': [0.9,0.8,0.7,0.6,0.5], 'colsample_bytree': [0.9,0.8,0.7,0.6,0.5]} xgb_model = xgbclassifier(objective = 'multi:softprob', nthread = 4, n_estimators= 1000, seed = 1337, silent = 0) clf = gridsearchcv(estimator=xgb_model,param_grid=parameters,n_jobs=-1,verbose = 5) clf.fit(orders_prior1[['user_id','order_number','order_dow','order_hour_of_day','days_since_prior_order']]\ ,orders_prior1['product_id'], orders_prior1['user_order'])
here error:
traceback (most recent call last): file "c:\anaconda3\lib\site-packages\sklearn\externals\joblib\_parallel_backends.py", line 344, in __call__ return self.func(*args, **kwargs) file "c:\anaconda3\lib\site-packages\sklearn\externals\joblib\parallel.py", line 131, in __call__ return [func(*args, **kwargs) func, args, kwargs in self.items] file "c:\anaconda3\lib\site-packages\sklearn\externals\joblib\parallel.py", line 131, in <listcomp> return [func(*args, **kwargs) func, args, kwargs in self.items] file "c:\anaconda3\lib\site-packages\sklearn\model_selection\_validation.py", line 238, in _fit_and_score estimator.fit(x_train, y_train, **fit_params) file "c:\anaconda3\lib\site-packages\xgboost\sklearn.py", line 445, in fit verbose_eval=verbose) file "c:\anaconda3\lib\site-packages\xgboost\training.py", line 205, in train xgb_model=xgb_model, callbacks=callbacks) file "c:\anaconda3\lib\site-packages\xgboost\training.py", line 76, in _train_internal bst.update(dtrain, i, obj) file "c:\anaconda3\lib\site-packages\xgboost\core.py", line 806, in update _check_call(_lib.xgboosterupdateoneiter(self.handle, iteration, dtrain.handle)) oserror: [winerror -529697949] windows error 0xe06d7363
i posted quite similar question (except using neural network classifier) few days ago still, did not positive answer. ideas on why kind of error happens , how resolve kind of error? maybe try different language? although python became key language dealing data-science problems, using different language on problem. in advance.
Comments
Post a Comment