AI Paper Atlas

Research map / Probabilistic and scientific modeling / Molecules and proteins

Copula-Nested Spectral Kernel Network

Jinyue Tian, Hui Xue, Yanfang Xue, Pengfei Fang

ICML 2024 · Probabilistic and scientific modeling › Molecules and proteins · approach: Sparse graphical and tensor models

Read the paperCheck your idea against 137,217 papers

AI-extracted summary. Written by AI from the paper's full text. Numbers and claims can be wrong or missing context, so check the paper before you cite or build on it.

Proposes CokeNet, a spectral kernel network whose spectral density is defined via Archimedean copulas (generator learned as a Laplace-transform network), evaluated on synthetic and UCI classification/regression tasks.

Problem

Spectral kernel networks rely on restrictive, hand-chosen spectral densities (traditional kernel densities or Gaussian mixtures) that ignore dependence structure between frequency variables, limiting the hypothesis space.

Approach

Redefine the spectral density as a copula density times a pseudo-density (via Sklar's theorem), and parameterize the Archimedean copula generator as a learnable one-layer exponential network (Copula Net, justified by Bernstein's theorem), so the copula is trained end-to-end inside the spectral kernel mapping.

Measured effects reported in the paper

What was changedWhereMeasuredEffect
add the copula-nested spectral kernel to the spectral kernel networkSKN · DistalPhalanxOutlineCorrectaccuracy: 0.7789 -> 0.8007Improved
add the copula-nested spectral kernel to the spectral kernel networkSKN · Earthquakesaccuracy: 0.7482 -> 0.7553Improved
add the copula-nested spectral kernel to the spectral kernel networkSKN · HandOutlinesaccuracy: 0.9108 -> 0.9135Improved
add the copula-nested spectral kernel to the spectral kernel networkSKN · DistalPhalanxTWaccuracy: 0.6474 -> 0.6618Improved
add the copula-nested spectral kernel to the spectral kernel networkSKN · ProximalPhalanxOutlineCorrectaccuracy: 0.8866 -> 0.9072Improved
add the copula-nested spectral kernel to the spectral kernel networkSKN · ProximalPhalanxTWaccuracy: 0.8049 -> 0.8146Improved
replace the copula module with same-dimensional parameters independent of the weights (ablation)CokeNet · six real-world classification datasetsaccuracy: 0.8007 -> 0.7282; 0.7553 -> 0.7482; 0.9135 -> 0.9081; 0.6618 -> 0.6187; 0.9072 -> 0.9037; 0.8146 -> 0.7951Hurt
replace the copula network with a ReLU neural network (ablation)CokeNet · six real-world classification datasetsaccuracy: 0.8007 -> 0.7355; 0.7553 -> 0.7482; 0.9135 -> 0.9054; 0.6618 -> 0.6402; 0.9072 -> 0.9003; 0.8146 -> 0.7707Hurt
use a copula moduleSKN · synthetic classification datasets with dependence degrees 0.01, 0.1, 0.3, 0.5, 0.7, 0.9, 0.999accuracy: 0.5616 -> 0.5800; 0.5366 -> 0.5616; 0.5433 -> 0.5750; 0.5916 -> 0.5950; 0.6516 -> 0.6600; 0.7616 -> 0.7650; 0.9700 -> 0.Improved
replace the copula module with parameters independent of the weights (ablation)CokeNet · synthetic classification datasetsaccuracy: 0.5800 vs 0.5250, 0.5516, 0.5483, 0.5816, 0.6583, 0.7566, 0.9750Mixed
replace the copula network with a ReLU neural network (ablation)CokeNet · synthetic classification datasetsaccuracy: 0.5800 vs 0.5383, 0.5300, 0.5300, 0.5750, 0.6400, 0.7583, 0.9716Mixed

Surprising findings

Limitations

Experimental setup

Datasets: UCI DistalPhalanxOutlineCorrect UCI Earthquakes UCI HandOutlines UCI DistalPhalanxTW UCI ProximalPhalanxOutlineCorrect UCI ProximalPhalanxTW synthetic 2-D dependence data UCI power, concrete, yacht, airfoil, boston, wine red, wine white (regression, appendix) CIFAR10 (appendix)

Benchmarks: UCI time-series/image classification (six datasets) synthetic dependence classification UCI regression (appendix) CIFAR10 (appendix)

Metrics: classification accuracy MSE

Baselines: DSKN ASKL CosNet GRFF SRFF SKN

Builds on: Random Fourier Features Deep Spectral Kernel Network ACNet Complex-valued spectral kernel network

Closest papers by meaning

Writing a paper in this area? scime draft is a free LaTeX editor with AI included, real-time co-authors and a check of your references and venue rules before you submit. It also imports OpenAI Prism projects.

Open scime draft

Get the next scime Dispatch and a monthly field update

Free. We send a confirmation link first; every email has a one-click unsubscribe. Privacy