Prologue : The aptness of this title is known to me only after I lost my first draft of this article by accident. Sure enough it is frustrating but let's focus on my deal with Software System Design. The second writeup will not have any dramatic entries I had in my first one but focus on MVP.
The knowledge of Big Data System Design has many components which can be happily group into various categories. My plan is to write one blog per category so that I understand them in more detail. This is to help me store all my learning at one place and help as a quick guidebook when times comes for Job Interviews or Project Execution.
The various categories that come to my mind so far are:-
The knowledge of Big Data System Design has many components which can be happily group into various categories. My plan is to write one blog per category so that I understand them in more detail. This is to help me store all my learning at one place and help as a quick guidebook when times comes for Job Interviews or Project Execution.
The various categories that come to my mind so far are:-
- Data Orchestration : Hbase, Flume, Zookeeper
- Search : Solr, Elasticsearch
- Data Access : Pig, Hive, Sqoop
- Hadoop : HDFS, MapReduce, Yarn
- Spark : Stream Processing
- NoSQL Database : MongoDB, Casandra
- Load Balancers : HAProxy, Nginx
- Message Broker : RabbitMQ, Kafka
- High Availability & Scalability
- Container Orchestration Engine : Mesos, Kubernetes or Swarm
No comments:
Post a Comment