Looking at Your Data

Looking at Your Data

What to do first after scoping out and starting a data science project? I’ve started an unsupervised learning project based on textual data. The first thing I like to do is actually look at the data. Is it noisy? What are the features—complex feature engineering needed? How heterogeneous? What generalization and overfitting challenges? Analysis can take many forms: actually looking at the numbers, using visualization tools, Excel spreadsheet, Ju…