Internet Scale Websites
Designing an Internet Scale Website is not the same as developing an Enterprise Application. With small to medium scale enterprise applications you get more liberty to imperfect things. When you meet 10million hits/day there is no room for error, imperfection or ill design. First of all whether it be any of the above two we always ... always keep our UI stateless, all state either lies in the distributed cache or in the datastore. Even if we write a small CRUD app or a Facebook app we follow the same scalability principles though to different degrees. We brainstorm and remove every race condition, deadlocks, unnecessary locks, and performance problems. We won't give you loads of Heavy Bloated Apps and instruct you to run it on the cloud if you want to scale, or tell you scaling up or scaling out is the only solution. Non-Scalability cannot be cured, it has to be prevented conciously from the start. In the end you will only be able to test and get metrics but will mostly not be able pay accumulated technical debt back.
Would you like us to help you with any of the following?...
1) Hadoop et. al.
Data & Compute Grids
Distributed Queues & Topics (Store & Forward + Master-Slave Failover)
3) Proprietary Ones Too. MQSeries,... etc.
Massively Parallel Enterprise Systems/SOA With Single System Image
Internet Scale Data-Mining *
Internet Scale Search Engines *
1) Nutch (Outdated)
2) Droids
3) Tika
4) Open Relevance
5) Solr
NLP, linguistics, common sense reasoning, cognitive science, artificial intelligence, information retrieval, semantic web and machine learning *
1) AlchemyAPI
2) NLTK
3) General Architecture For Text Engineering
4) MontyLingua
5) Open Pipeline
6) Unstructured Information Management Architecture
Relational Databases (Sharded + Read-Write Replicated For Scaling, & Master-Master Failover Replicated)
1) MySQL
2) SQL Server
3) Oracle
We will mix and match the best of the above to create solutions for you. Give us a call and state your project details and we will get back to you with a solution.
Reference: