Aditya Yadav & Associates

Architecting World Class Engineering Companies

Home
Mobile
Books
Pocket Guides
Research Reports
Products
Consulting
CloudEase - Enterprise
User eXperience
Presentations
EAI / SOA / ROA / MOA
CEP
GPU/FPGA
QA
Web2.0 & Enterprise2.0
Internet Scale Websites
Cloud Computing
Peer To Peer
Technology Strategy
Agile
Lean
Labs
Articles & Whitepapers
Blogs
Podcasts
Videocasts
Training
Tools We Recommend
Press Release(s) And News
The Way We Work
Contact Us
Internet Scale Websites

Designing an Internet Scale Website is not the same as developing an Enterprise Application. With small to medium scale enterprise applications you get more liberty to imperfect things. When you meet 10million hits/day there is no room for error, imperfection or ill design. First of all whether it be any of the above two we always ... always keep our UI stateless, all state either lies in the distributed cache or in the datastore. Even if we write a small CRUD app or a Facebook app we follow the same scalability principles though to different degrees. We brainstorm and remove every race condition, deadlocks, unnecessary locks, and performance problems. We won't give you loads of Heavy Bloated Apps and instruct you to run it on the cloud if you want to scale, or tell you scaling up or scaling out is the only solution. Non-Scalability cannot be cured, it has to be prevented conciously from the start. In the end you will only be able to test and get metrics but will mostly not be able pay accumulated technical debt back.



Would you like us to help you with any of the following?...

1) Hadoop et. al.
       a) Hadoop MapReduce
       b) HBase Internet Scale Database,  
       c) Hive Datawarehouse,
       d) Pig DataAnalysis

Data & Compute Grids
4) JPPF
9) DAC
 
 
Key-Value Databases (Extremely Low Latency)

1) Memcached
2) MemCacheDB
3) Project Voldemort
4) LightCloud
5) Redis

Document Oriented Databases

1) MongoDB
2) CouchDB

Column Oriented Databases

1) Cassandra

Graph Databases

1) HyperGraphDB
 
Distributed Queues & Topics (Store & Forward + Master-Slave Failover)
 
3) Proprietary Ones Too. MQSeries,... etc. 
 
Massively Parallel Enterprise Systems/SOA With Single System Image
 
 
Internet Scale Data-Mining *
 
 
Internet Scale Search Engines *
 

1) Nutch (Outdated)

2) Droids

3) Tika

4) Open Relevance

5) Solr

 

NLP, linguistics, common sense reasoning, cognitive science, artificial intelligence, information retrieval, semantic web and machine learning *

 

1) AlchemyAPI

2) NLTK

3) General Architecture For Text Engineering

4) MontyLingua

5) Open Pipeline

6) Unstructured Information Management Architecture

  
Relational Databases (Sharded + Read-Write Replicated For Scaling, & Master-Master Failover Replicated)

1) MySQL
2) SQL Server
3) Oracle

We will mix and match the best of the above to create solutions for you. Give us a call and state your project details and we will get back to you with a solution.


Reference: