Theory vs. Learning Models

See on Scoop.itWhat is Data Science

Trying to make a priori theoretical sense of the relationships of over a dozen attributes to an outcome is a complicated undertaking

Carla Gentry CSPO‘s insight:

What the visualizations suggested to me is that the features Mike’s analyses hypothesized/tested as significant were indeed so, but that some of the relationships might in fact be non-linear and there may well be interaction effects in the data not captured in the regression models. And I suspect that by training and testing on the same data, the reported models might be somewhat overfit — the actual relationships not as strong as those reported.

See on

Leave a comment

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: