|
In a non-sharded DB, I could just use auto-increment to generate a unique ID to reference a specific row.
I want to shard my DB, say into 12 shards. Now when I insert into a specific shard, the auto-increment ID is no longer unique.
Would like to hear...
Started by Continuation on
, 4 posts
by 4 people.
Answer Snippets (Read the full thread at stackoverflow):
In this approach you allocate a....
A few approaches
1) Give each shard it's own ID, and use a composite key
2) Give each shard it's own ID and set ID ranges for each shard
3) Use a globally unique ID - GUID
1) You can two rows (one.
|
|
What is the concept of Sharding from Database Design perspecitve ?
Started by Rachel on
, 3 posts
by 3 people.
Answer Snippets (Read the full thread at stackoverflow):
Each partition forms part of a shard.
Separately, rather than splitting by columns (as for normalization).
|
|
I have heard the 'shard' technique mentioned several times with regard to solving scaling problems for large websites. What is this 'shard' technique and why is it so good?
Started by Phil Wright on
, 4 posts
by 4 people.
Answer Snippets (Read the full thread at stackoverflow):
In brief, ....
How you separate your data is up to you, but generally it’s done on some fundamental identifier .
From the post:
Sharding is the separation of your data across multiple servers.
Karl Seguin has a good blog post about sharding.
|
Ask your Facebook Friends
|
What's the best way to deal with a sharded database in Rails? Should the sharding be handled at the application layer, the active record layer, the database driver layer, a proxy layer, or something else altogether? What are the pros and cons of each?...
Started by Teflon Ted on
, 6 posts
by 6 people.
Answer Snippets (Read the full thread at stackoverflow):
You then....
That makes it pretty simple if you need to make cross-shard calls.
Design-coming-shard
FiveRuns have a gem named DataFabric that does application-level sharding for each shard that overrides the connection property.
|
|
Hello,
I was wondering what the best technique for implementing a DB connection pool for a web application which uses shards. From what I can tell most (all?) open-source implementations only support a single database behind. At least, I have not found...
Started by Steve on
, 4 posts
by 4 people.
Answer Snippets (Read the full thread at stackoverflow):
This is not really much additional work since you need the shard config anyway to determine ....
If you to shard info in additional to db pool.
Hash function) and a manager class to track multiple pools .
A shard mapping function(e.g.
|
|
So the level 150 Strength +6 Shard requires fewer greater essences than the level 100 Strength +6 Shard.
Is this supposed to be this way?
Started by WielderofGigantus on
, 6 posts
by 5 people.
Answer Snippets (Read the full thread at ddo):
The only difference....
How many lessers do the two different shards need? Any special ingredients for the lvl150 shard do the two different shards need? Any special ingredients for the lvl150 shard? Everything else is the same.
|
|
Just wonder how good is Propel's support for database sharding? I am thinking about creating my application in PHP, using MySQL as the database server and Propel as the ORM.
I figure out that it may be good to keep the architecture scalable right from...
Started by Ngu Soon Hui on
, 3 posts
by 3 people.
Answer Snippets (Read the full thread at stackoverflow):
Assuming that you need to shard your data is not a good assumption.
I think that's a very bad idea.
|
|
I'm working with a database schema that is running into scalability issues. One of the tables in the schema has grown to around 10 million rows, and I am exploring sharding and partitioning options to allow this schema to scale to much larger datasets...
Started by jordan002 on
, 5 posts
by 5 people.
Answer Snippets (Read the full thread at stackoverflow):
Million rows is really not large in DBMS terms and I'd be looking first at my indexing and query plans before starting to plan a physical distribution of data with shards or partitions, which shouldn't really be necessary until your table's ....
|
|
I'm working on a web app that is somewhere between an email service and a social network. I feel it has the potential to grow really big in the future, so I'm concerned about scalability.
Instead of using one centralized MySQL/InnoDB database and then...
Started by Seun Osewa on
, 7 posts
by 7 people.
Answer Snippets (Read the full thread at stackoverflow):
So why use a relational database at all?
If your data is this easy to shard, why not just use a standard database engine....
The place where this will fail is if you have to do what's called "shard walking" - which is finding relationships...
|
|
Hi all,
thanks for your time first...after all the searching on google, github and here, and got more confused about the big words(partition/shard/fedorate)，I figure that I have to describe the specific problem I met and ask around.
My company's databases...
Started by Utensil on
, 3 posts
by 3 people.
Answer Snippets (Read the full thread at stackoverflow):
All the existing solutions that you mention were....
If you want that particular DSL, or something that matches the logic behind the legacy sharding you are going to need to dig into ActiveRecord and write a gem to give you that kind of capability.
|
