Intro to Data Analysis - Module 2
Unstructured Data
Free-form data that can't be organized into rows and columns.
Define Structured Data?
Data that's well organized and in formats that can be stored in a database. (such as a csv file)
Define Semi-Structured Data?
Data that's partially organized and partially free-form. (For example, emails)
What do Query Languages do with data?
Access and manipulate data from databases.
What do Programming Languages do with data?
Develop applications and control their behavior.
What do Shell and Scripting languages do with data?
Automate repetitive operational tasks.
What's a Data Repository?
Data that has been:
- COLLECTED
- ORGANIZED
- ISOLATED
Before being used for reporting, analytics and archival purposes.
Name Five Types of Data Repositories
- DATABASES (Relational & Non-Relational
- DATA WAREHOUSES
- DATA MARTS
- DATA LAKES
- BIG DATA STORES
What's defines a Database?
[DATA REPOSITORY] - Defined by:
- Following a set of organizational principles
- Only storing specific data
- Using specific tools to query, organize, and retrieve data
What's a Data Warehouse?
[DATA REPOSITORY] - Consolidates incoming data in one place.
What's a Data Mart?
[DATA REPOSITORY] - Sub-section of a warehouse that isolates data for a specific use case.
What's a Data Lake?
[DATA REPOSITORY] - Stores large amounts of structured, semi-structured, and unstructured data in their native format.
*Often used as staging areas.
What does a Big Data Store do? (2 parts)
[DATA REPOSITORY] - 1. Distributes computational and storage infrastructure.
2. Used to store, scale, and process very large data sets.
What's the ETL process?
An automated process that converts raw data into analysis ready data.
Describe the ETL process
EXTRACT data from source location.
TRANSFORM raw data by cleaning, enriching, standardizing, and validating it.
LOADING the processed data into a destination system or data repository.
Is a Data Pipeline and ETL process the same thing? Explain.
Yes. Both encompass the process of moving data from its source to a destination such as a data lake or application.
What's Big Data?
The vast amount of data being produced by people, tools, apps, and machines.
What are The Vs of Big Data?
[V]ELOCITY
[V]OLUME
[V]ARIETY
[V]ERACITY
[V]ALUE
Velocity
The speed at which data accumulates.
Volume
The scale of the data or the physical size of stored data.
Variety
The diversity of the data such as sources and data type.
Veracity
The quality and origin of the data including consistency, completeness, integrity, and ambiguity.
Value
The potential to turn the data into tangible value.
| Quiz |
|---|
| examen spe |
| glosor v 3 |
| 4 Fun |
| 2 Great |
| i sumeri |
| Intro to Data Analysis - Module 1 |
| forensic instrumentation |
| chapter 9 |
| tisular - copia |
| tisular |
| Exam |
| siciologia |
| laylay |
| 1 mycket |
| engelska glosor 1 |
| bio 207 lab |
| bio 207 lecture 1-3 |
| aa |
| love and relationships |
| vulcanismo |
| family |
| Privat elonomiprivat ekonomi |
| figure de stylenon enft |
| China |
| l'organisme pluricellulaire |
| glosor 1 |
| anglais |
| Impact of WWI and WWII onto surgery and technology |
| Terminologie (Radicaux) (Q-R) |
| proteine |
| geografia tema 6 |
| WWI impact of surgery |
| all the vocabulary words listed |
| Unit 7, Unit 8, Unit 9, Unit 10, Unit 11 |
| Arsène Lupinpas de description |
| 7th Grade English VocabularyUnit 11 |
| T. 7. El montaje |
| Actual boards |
| svenska prov |
| Tema 5: autores |
| PROPRIÉTÉS GÉOMÉTRIE |
| latijn moeilijke woorden 12-18 |
| spanska verb |
| Soins |
| franska 3a |
| hang - meet |
| 7th Grade English VocabularyUnit 10 |
| 7th Grade English VocabularyUnit 9 |
| Valencias mesa periodica |
| numeros de oxidacion |
| nil |
| Processrätttvister |
| Rätten och samhället kap 3 |
| bedrijfsvoering deel 2 |
| nawi |
| Biochimica clinicaè per un esame un universitario |
| giada |
| Social Psychology"Social Psychology" by Pearson 10e |
| Terminologie (Radicaux) (P) |
| anglais |
| FIGURE RETORICHE |
| tipolgie rime |
| figure retoriche 1 |
| compraventa y arrendamientobloque4 |
| CONTRATO: concepto,clases, elementos, formación, eficacia e ineficaciabloque 3.3 |
| CUMPLIMIENTO E INCUMPLIMIENTO DE LAS OBLIGACIONESbloque 3.2 |
| OBLIGACION: CONCEPTO, FUENTES Y CLASESbloque 3.1 |
| PERSONA JURIDICA: CLASES,CARACTERISTICAS, ASOCIACIONES Y FUNDACIONESbloque 2.2 priv |
| LAS PERSONAS,CAPACIDAD JURÍDICA Y ESTADO CIVIL DE LAS PERSONAS Y PERSONASCASADASbloque 2.1 privado |
| Ite |
| mathseasy class 6 maths questions |
| Allgemeines Verwaltungsrecht |
| Historia Dactiloscopia |
| cous remi |
| les fonctions grammaticale |
| Geografi - kopia |
| mapeh 9 second quarters |
| Trig & Coordinate Geom Quiz |
| bedrijfsvoeringleren voor bedrijfsvoering |
| french relfective verbs |
| sociology |
| geschichte test |
| prov 2 |
| The Liberal reforms 1906-1912 |
| koreanKorean alphabet |
| Alexander Flemming and discovery of Penicillin |
| days |
| Químicaa |
| Valències |
| Termoquímica |
| 3 |
| svenska Litteraturhistoria |
| vocabulaire Gun Culture |
| tenta1hejhej |
| espagnol |
| Medicinsk terminologi kroppens anatomi |
| Anglais |
| 7th Grade English VocabularyUnit 8 |
| terms |
| DefinitionerInför kursprov |
| Terminologie (Radicaux) (O) |
| Naturvetenskap |
| Terminologie (Radicaux) (N) |
| Glosor till 17/1 |
| Terminologie (Radicaux) (M) |
| Terminologie (Radicaux) (L) |
| födelse dagar |
| 開始 1.5K |
| sobre los verbos en subjubtivo en español |
| guerra civil fechas |
| v.4 |
| guerra civil |
| PSI 1 |
| ColoresKolory |
| clostridium perfringens en alimentos |
| hygiene Fragen |
| listeria monocytogenes en alimentos |
| Mapeh (PE) 3rd test |
| Science (3rd test) |
| TLE (Livelihood) 3rd test |
| English (3rd test) |
| v.3 |
| el racismo 2.3 |
| Allemand |
| Sanskritsanskrit |
| 7th Grade English VocabularyUnit 7 |
| Socail studies ancient greece exam review |
| Biology week 2 Terms |
| Frans Traject 2 |
| el racismo 2.2 |
| meara |
| a |
| el racismo 2.1 |
| la inmigración 1.3 |
| suggestions, hypothesis, and conclusions |
| adding more information and giving explanations/examples |
| biochimie |
| opinion expression and figures |
| spanska klassrum |
| History mock Paper 3 Russia |
| vocabulaire espagnol internet |
| metallurgia |
| FBL |
| resumo |
| ord |
| nucleic acids |
| la france:milieux metropolitains et ultramarins entre valorisation et protection |
| compound ions |
| la inmigración 1.2 |
| Hormoner mm |
| Interview Questions |
| microsoft excel 2016 |
| la inmigración 1.1 |
| CHAP 4 BLED |
| rois de france |
| rois de france |
| test |
| Geografi |
| elp |
| Traduce_semana_3 |
| latin vocabulaei |
| bioch |
| Edwards death |
| The battle of gate fulford |
| The battle of stanford bridge |
| the harrying of the North (1069-1070) |
| The rebellion in the south west (1067-1069) |
| Fremdwörter 2. sa U 15 & 16 |
| Words of the Week |
| U16 |
| apparato digerente, respiratorio, cardiovascolatore |
| apparato digerente, respiratorio, cardiovascolatore |
| science |
| apparato nervoso, cardiovascolatore, digerente, respiratorio |
| apparato digerente, apparato respiratorio, apparato cardiovascolatore, nervoso |
| apparato digerente |
| apparato digerente |
| apparato respiratodio |
| apparato digerente |
| perfekt del 3 |
| def hg courtes |
| History mock paper 2 War |
| Spanska glosor |
| anatomia |
| anatomia |
| anatomia |
| anatomia |
| anatomia |
| anatomia |
| anatomia |
| Hair and Style |
| vocaboli di greco - copia |
| anatomia |
| anatomia |
| anatomia |
| Moddies |
| Rebellion in the southwest (1067-1069) |
| anatomia |
| Svåra ord modul 3 |
| synthese |
| fisiologia |
| latin |
| Moddies |
| lessico 34 |
| latinglosor |
| lessico 33 |
| bo ställenvi ska kunna gör varierande meningar med olika at home usful words
och över sätta dem till svenska |
| lessico 32 |
| lessico 31 |
| lection 8 |
| lessico 30 |
| Lection 7 |
| lection 6 |
| Lection 5 |
| Teoremi Analisi I |
| franz |
| Endocrine System |
| The Weak Voice Quiz |
| Sverige och svenskarna åk 8 |
| Sp glosor |
| PoetryLove and Relationships |
| spanish listening |
| kommunikation |
| Portugal a 1 república |
| History Mock Paper 2 Authoritarian states |
| Foreign Language |
| lection 4 |
| Lection 3 |
| lection 2 |
| Lection 1 |
| substanstiv- plural |
| berättande |
| humör |
| allemand |
| Hinduism begrepp |
| قرن 20 |
| Stat 151 |
| sciencescience study Guide plants and food and fiber |
| bio test on who knows really |
| personalidad |
| chemistry |
| gcse biology paper 1 and 2 |
| NIK400OMtenta |
| Geography countries |
| hg |
| ecosystems |
| Geografia |
| cranix |
| tabarie |
| Preperations for the battle of hastings |
| English |
| vokabeln |
| The battle of gate fulfordUnit 1 - late anglo-saxon england |
| چین |
| labai skanu- to like, ordering, asking |
| atmung/lunge |
| anatomie (bewegungssystem) |
| litauiska family de 3 |
| NIK 400Först Tenta |
| anatomia locomotore |
| C2 Complexité du système climatique |
| Ukrainaka |
| Nederlands Se1 |
| Stress |
| Robotic |
| Virituell production Robotic |
| T. 6. El sonido |
| T.5. El tiempo |
| RTE 003- roots, prefix, suffix- cell structures |
| RTE 003 |
| PLMS 2 |
| unit 3 |
| patient care |
| Italienisch |
| excell |
| franska glossor 1 |
| vocabulaire |
| inss banco do brasilme diga tudo sobre o inss |
| Physics 10-1 formulas |
| anatomia |
| verbessaper |
| Electromagnetic Induction |
| Cristallographie première |
| Italian |
| spanska - kopia |
| nl 1.3 |
| spanska |
| Magnetic Fields |
