FrontPage BigData

Difference between r1.1 and the current

@@ -1,3 +1,27 @@
Usually defined by three elements:
1. Volume
1. Velocity (speed)
1. Variety
Proper organization and use of them is as much important as having them.
Organizations
* Relational Data Model: RDBMS (Relational Database Management System), mainly implemently by SQL (Structured Query Language).
* Entity-Relationship Data Model (ER): . . . It added additional abstraction to increase the usability of the data. In the model, each item was defined independently of its use. Therefore, developers could create new relationships between data sources without complex programming [[FootNote(Big Data For Dummies, 2013)]].
* Data warehouse in 90s
* Beginning of unstructured data use -- BLOBs (Binary Large Objects)
* Object Database Management System (ODBMS).
The above has shown Structured -> Unstructured data. Therefore, building, organizing, integrating, analyzing, and deciding (utilizing the data) become extremely important.
* COIAA -- Capture, Organize, Integrate, Analyze, Act
Capture
* Setting architectural foundation
[[Attachment(BigDataArchitecture.jpg)]]
====
* Computer-generated or Machine-generated Data
* Human-generated Data
* Hybrid Data . . . .


Usually defined by three elements:
  1. Volume
  2. Velocity (speed)
  3. Variety

Proper organization and use of them is as much important as having them.

Organizations
  • Relational Data Model: RDBMS (Relational Database Management System), mainly implemently by SQL (Structured Query Language).
  • Entity-Relationship Data Model (ER): . . . It added additional abstraction to increase the usability of the data. In the model, each item was defined independently of its use. Therefore, developers could create new relationships between data sources without complex programming [1].
  • Data warehouse in 90s
  • Beginning of unstructured data use -- BLOBs (Binary Large Objects)
  • Object Database Management System (ODBMS).

The above has shown Structured -> Unstructured data. Therefore, building, organizing, integrating, analyzing, and deciding (utilizing the data) become extremely important.
  • COIAA -- Capture, Organize, Integrate, Analyze, Act

Capture
  • Setting architectural foundation

BigDataArchitecture.jpg
[JPG image (43.71 KB)]





  • Computer-generated or Machine-generated Data
  • Human-generated Data
  • Hybrid Data . . . .

  • Sensor data . . . . RFID tags, Smart meters, medical devices, GPS data, etc.
  • Web log data . . . Google analytics,
  • Point-of-sale data . . . Cashiers' swipes . . . .
  • Financial data
----
  • [1] Big Data For Dummies, 2013
Valid XHTML 1.0! Valid CSS! powered by MoniWiki
last modified 2014-07-23 14:33:55
Processing time 0.0248 sec