Source

Adapted from my own handwritten and hand-typed notes from Year 1 to Year 3 of my EEE degree

There are two primary data types:

  • Structured data: highly organised, clearly defined variables, easy to mine and analyse
  • Unstructured data: highly unorganised, non-obvious variables, highly context sensitive

Structured Data

KindContentExample sources
Numericcontinuous numeric variables (e.g. TV, radio, newspaper ad spend vs sales)spreadsheets (Excel, CSV), SQL databases, sensors
Categoricalfactor, level or class variables (e.g. car safety: low, med, high)spreadsheets, SQL databases, sensors
Mixednumeric and categorical together (e.g. price plus condition)spreadsheets, SQL databases
Time seriesnumeric values with timestamps on a clear time axisstock markets, weather over time, prices and promotions
Networknodes joined by clearly defined links or edgessocial networks, MRT network, financial transactions

Unstructured Data

KindContentExample sources
Textwords, phrases, emoticons, hashtagssocial media, WhatsApp, books, wikis
Imagepixels and objectsphone cameras, social media, blogs
Videoimages, frames, objectsYouTube, video calls
Voicevoice signals and wavessongs, microphones, recordings, Siri

Why It Matters

Points to note:

  • structured data can go straight into tables and statistics
  • unstructured data first needs feature extraction before analysis
  • the amount of unstructured data is huge because billions of people use the internet, YouTube, Facebook and so on every month

The course works mainly with one mixed structured dataset, the Pokemon Dataset.