CARVIEW |
Select Language
HTTP/2 301
date: Wed, 23 Jul 2025 23:34:39 GMT
content-type: text/html; charset=utf-8
content-length: 0
vary: X-PJAX, X-PJAX-Container, Turbo-Visit, Turbo-Frame, X-Requested-With,Accept-Encoding, Accept, X-Requested-With
location: https://github.com/minerva-ml/open-solution-value-prediction/wiki/bucketing-row-aggregations
cache-control: no-cache
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-frame-options: deny
x-content-type-options: nosniff
x-xss-protection: 0
referrer-policy: origin-when-cross-origin, strict-origin-when-cross-origin
content-security-policy: default-src 'none'; base-uri 'self'; child-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/; connect-src 'self' uploads.github.com www.githubstatus.com collector.github.com raw.githubusercontent.com api.github.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com *.rel.tunnels.api.visualstudio.com wss://*.rel.tunnels.api.visualstudio.com objects-origin.githubusercontent.com copilot-proxy.githubusercontent.com proxy.individual.githubcopilot.com proxy.business.githubcopilot.com proxy.enterprise.githubcopilot.com *.actions.githubusercontent.com wss://*.actions.githubusercontent.com productionresultssa0.blob.core.windows.net/ productionresultssa1.blob.core.windows.net/ productionresultssa2.blob.core.windows.net/ productionresultssa3.blob.core.windows.net/ productionresultssa4.blob.core.windows.net/ productionresultssa5.blob.core.windows.net/ productionresultssa6.blob.core.windows.net/ productionresultssa7.blob.core.windows.net/ productionresultssa8.blob.core.windows.net/ productionresultssa9.blob.core.windows.net/ productionresultssa10.blob.core.windows.net/ productionresultssa11.blob.core.windows.net/ productionresultssa12.blob.core.windows.net/ productionresultssa13.blob.core.windows.net/ productionresultssa14.blob.core.windows.net/ productionresultssa15.blob.core.windows.net/ productionresultssa16.blob.core.windows.net/ productionresultssa17.blob.core.windows.net/ productionresultssa18.blob.core.windows.net/ productionresultssa19.blob.core.windows.net/ github-production-repository-image-32fea6.s3.amazonaws.com github-production-release-asset-2e65be.s3.amazonaws.com insights.github.com wss://alive.github.com api.githubcopilot.com api.individual.githubcopilot.com api.business.githubcopilot.com api.enterprise.githubcopilot.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com copilot-workspace.githubnext.com objects-origin.githubusercontent.com; frame-ancestors 'none'; frame-src viewscreen.githubusercontent.com notebooks.githubusercontent.com; img-src 'self' data: blob: github.githubassets.com media.githubusercontent.com camo.githubusercontent.com identicons.github.com avatars.githubusercontent.com private-avatars.githubusercontent.com github-cloud.s3.amazonaws.com objects.githubusercontent.com release-assets.githubusercontent.com secured-user-images.githubusercontent.com/ user-images.githubusercontent.com/ private-user-images.githubusercontent.com opengraph.githubassets.com copilotprodattachments.blob.core.windows.net/github-production-copilot-attachments/ github-production-user-asset-6210df.s3.amazonaws.com customer-stories-feed.github.com spotlights-feed.github.com objects-origin.githubusercontent.com *.githubusercontent.com; manifest-src 'self'; media-src github.com user-images.githubusercontent.com/ secured-user-images.githubusercontent.com/ private-user-images.githubusercontent.com github-production-user-asset-6210df.s3.amazonaws.com gist.github.com; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com; upgrade-insecure-requests; worker-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/
server: github.com
set-cookie: _gh_sess=i%2FJQTn8JBJ3bvHhFnL5l0c%2FHVp5yHHKsQMEeqlNT4fgQeNX125EkniO5%2FdZaovQHINZtCFQ%2BtqY4LEhloYvHer1LGR%2BXD0YuFWKJjFSAXhiPRq7%2BDStQnhThY0lIOwrivi%2Fgub%2Fe7G%2FHjAXG4fOjNocnwK6McYixTkh%2BFZqVMbKv9zOWvtX5z7OPDVSTJFkfCVPcHgvbj%2BlPOFRwjUSHD5jaO4YG85PGCLOo9kYArYB1CZaEJjfkw25Gya9Zu41ffn%2F07n41aFNIwU7f9TO7ew%3D%3D--6QzX0J2Yljq%2BcnER--hD9MLzN4CmXyQSP4xZPJbA%3D%3D; Path=/; HttpOnly; Secure; SameSite=Lax
set-cookie: _octo=GH1.1.728203389.1753313678; Path=/; Domain=github.com; Expires=Thu, 23 Jul 2026 23:34:38 GMT; Secure; SameSite=Lax
set-cookie: logged_in=no; Path=/; Domain=github.com; Expires=Thu, 23 Jul 2026 23:34:38 GMT; HttpOnly; Secure; SameSite=Lax
x-github-request-id: A57A:EE750:196DAD:234627:6881718E
HTTP/2 200
date: Wed, 23 Jul 2025 23:34:39 GMT
content-type: text/html; charset=utf-8
vary: X-PJAX, X-PJAX-Container, Turbo-Visit, Turbo-Frame, X-Requested-With,Accept-Encoding, Accept, X-Requested-With
x-robots-tag: none
etag: W/"733e5456b18802c87c1965908bdae39f"
cache-control: max-age=0, private, must-revalidate
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-frame-options: deny
x-content-type-options: nosniff
x-xss-protection: 0
referrer-policy: no-referrer-when-downgrade
content-security-policy: default-src 'none'; base-uri 'self'; child-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/; connect-src 'self' uploads.github.com www.githubstatus.com collector.github.com raw.githubusercontent.com api.github.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com *.rel.tunnels.api.visualstudio.com wss://*.rel.tunnels.api.visualstudio.com objects-origin.githubusercontent.com copilot-proxy.githubusercontent.com proxy.individual.githubcopilot.com proxy.business.githubcopilot.com proxy.enterprise.githubcopilot.com *.actions.githubusercontent.com wss://*.actions.githubusercontent.com productionresultssa0.blob.core.windows.net/ productionresultssa1.blob.core.windows.net/ productionresultssa2.blob.core.windows.net/ productionresultssa3.blob.core.windows.net/ productionresultssa4.blob.core.windows.net/ productionresultssa5.blob.core.windows.net/ productionresultssa6.blob.core.windows.net/ productionresultssa7.blob.core.windows.net/ productionresultssa8.blob.core.windows.net/ productionresultssa9.blob.core.windows.net/ productionresultssa10.blob.core.windows.net/ productionresultssa11.blob.core.windows.net/ productionresultssa12.blob.core.windows.net/ productionresultssa13.blob.core.windows.net/ productionresultssa14.blob.core.windows.net/ productionresultssa15.blob.core.windows.net/ productionresultssa16.blob.core.windows.net/ productionresultssa17.blob.core.windows.net/ productionresultssa18.blob.core.windows.net/ productionresultssa19.blob.core.windows.net/ github-production-repository-image-32fea6.s3.amazonaws.com github-production-release-asset-2e65be.s3.amazonaws.com insights.github.com wss://alive.github.com api.githubcopilot.com api.individual.githubcopilot.com api.business.githubcopilot.com api.enterprise.githubcopilot.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com copilot-workspace.githubnext.com objects-origin.githubusercontent.com; frame-ancestors 'none'; frame-src viewscreen.githubusercontent.com notebooks.githubusercontent.com; img-src 'self' data: blob: github.githubassets.com media.githubusercontent.com camo.githubusercontent.com identicons.github.com avatars.githubusercontent.com private-avatars.githubusercontent.com github-cloud.s3.amazonaws.com objects.githubusercontent.com release-assets.githubusercontent.com secured-user-images.githubusercontent.com/ user-images.githubusercontent.com/ private-user-images.githubusercontent.com opengraph.githubassets.com copilotprodattachments.blob.core.windows.net/github-production-copilot-attachments/ github-production-user-asset-6210df.s3.amazonaws.com customer-stories-feed.github.com spotlights-feed.github.com objects-origin.githubusercontent.com *.githubusercontent.com; manifest-src 'self'; media-src github.com user-images.githubusercontent.com/ secured-user-images.githubusercontent.com/ private-user-images.githubusercontent.com github-production-user-asset-6210df.s3.amazonaws.com gist.github.com; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com; upgrade-insecure-requests; worker-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/
server: github.com
content-encoding: gzip
accept-ranges: bytes
x-github-request-id: A57A:EE750:196DB8:23463C:6881718E
bucketing row aggregations Β· minerva-ml/open-solution-value-prediction Wiki Β· GitHub
Skip to content
Navigation Menu
{{ message }}
This repository was archived by the owner on Jun 22, 2022. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 21
bucketing row aggregations
Kamil A. Kaczmarek edited this page Jul 10, 2018
·
4 revisions
- more aggregations implemented here: feature_extraction.py#L111.
aggregations = {'non_zero_mean': non_zero_values.mean(),
'non_zero_std': non_zero_values.std(),
'non_zero_max': non_zero_values.max(),
'non_zero_min': non_zero_values.min(),
'non_zero_sum': non_zero_values.sum(),
'non_zero_skewness': skew(non_zero_values),
'non_zero_kurtosis': kurtosis(non_zero_values),
'non_zero_median': non_zero_values.median(),
'non_zero_q1': np.percentile(non_zero_values, q=25),
'non_zero_q3': np.percentile(non_zero_values, q=75),
'non_zero_log_mean': np.log1p(non_zero_values).mean(),
'non_zero_log_std': np.log1p(non_zero_values).std(),
'non_zero_log_max': np.log1p(non_zero_values).max(),
'non_zero_log_min': np.log1p(non_zero_values).min(),
'non_zero_log_sum': np.log1p(non_zero_values).sum(),
'non_zero_log_skewness': skew(np.log1p(non_zero_values)),
'non_zero_log_kurtosis': kurtosis(np.log1p(non_zero_values)),
'non_zero_log_median': np.log1p(non_zero_values).median(),
'non_zero_log_q1': np.percentile(np.log1p(non_zero_values), q=25),
'non_zero_log_q3': np.percentile(np.log1p(non_zero_values), q=75),
'non_zero_count': non_zero_values.count(),
'non_zero_fraction': non_zero_values.count() / row.count()
}
- added per bucket aggregations where the columns are divided into buckets and for each bucket the aggregations are calculated. This is parametrized with:
row_aggregations__bucket_nrs: "[1, 2]"
For instance here aggregations are calculated for 1 bucket (the entire dataset) and for each of 2 buckets.
- Less leaves, no row sampling and more column sampling improved both local CV and public LB. My guess is that less complexity resulted in less overfitting.
- model parameters
# Light GBM
lgbm_random_search_runs: 0
lgbm__device: cpu # gpu cpu
lgbm__boosting_type: gbdt
lgbm__objective: rmse
lgbm__metric: rmse
lgbm__number_boosting_rounds: 10000
lgbm__early_stopping_rounds: 1000
lgbm__learning_rate: 0.001
lgbm__num_leaves: 16
lgbm__max_depth: -1
lgbm__min_child_samples: 1
lgbm__max_bin: 300
lgbm__subsample: 1.0
lgbm__subsample_freq: 1
lgbm__colsample_bytree: 0.1
lgbm__min_child_weight: 10
lgbm__reg_lambda: 0.1
lgbm__reg_alpha: 0.0
lgbm__scale_pos_weight: 1
lgbm__zero_as_missing: False
- lightGBM new aggregations + projections (second best) 1.333 CV 1.38 LB π

check our GitHub organization https://github.com/neptune-ml for more cool stuff π
Kamil & Kuba, core contributors
- honey bee π LightGBM and 5fold CV
- beetle πͺ² LightGBM on binarized dataset
- dromedary camel πͺ LightGBM with row aggregations
- whale π³ LightGBM on dimension reduced dataset
- water buffalo π Exploring various dimension reduction techniques
- blowfish π‘ bucketing row aggregations
Clone this wiki locally
You canβt perform that action at this time.