large and complex datasets that are too big or too fast for traditional data processing tools to handle effectively
-
3 Vs: way to describe challenges and characteristics of working with massive datasets
- Volume: amount of data
- Velocity: speed at which data is generated
- Variety: different types of data (e.g. structured, semi-structured, unstructured)
-
extra Vs:
- Veracity: data quality and trustworthiness
- Variability: changes in context, interpretation or collection methods
- Value: usefulness of the data