How database design fails us, and what to do about it

Good database design is crucial to obtain a sound, consistent database, and — in turn — good database design methodologies are the best way to achieve the right design. These methodologies are taught to most Computer Science undergraduates, as part of any Introduction to database class. They can be considered part of the “canon”, and indeed, the overall approach to database design has been unchanged for years. Should we conclude that database design is a solved problem?

The problem of database design is difficult, and it encompasses issues that may not be amenable to formalization. Hence, any method is likely to have some limitations and drawbacks. However, this is not a reason to ignore the serious problems that the traditional approach is running into:

  • the traditional approach is not followed in practice;
  • we ask practitioners to follow a model that is demanding and yields, in return, some very limited results.
Why does it fail us? Because we make the following assumptions:
  • Users are faceless objects for whom the systems are designed.  It’s “everything for the people, but without the people”. (IT people, like communists, love central planning.)
  • The information system is strongly consistent. (There is no such thing in practice.)
  • Our semantics is absolute. There is a single valid point of view. (Maybe if you live in a cave…)
  • Our models are static. Changes are uncommon. (Nonsense. The world is changing at a break-neck pace.)
Instead, data design methodologies should encourage us to design for
  • a distributed world and
  • imperfect knowledge.

What do you think?

Further reading: I wrote a long-form paper on this topic with Antonio Badia: A Call to Arms: Revisiting Database Design, SIGMOD Record 40 (3), 2011. ACM makes the PDF freely available. We back all our observations with  references.

Published by

Daniel Lemire

A computer science professor at the University of Quebec (TELUQ).

4 thoughts on “How database design fails us, and what to do about it”

  2. “IT people, like communists, love central planning.”

    I love this quote because it’s true. I am consistently having to dissuade people from coming up with a centralized service that controls other services. That path is fraught with danger.

    I have put your paper on my reading list with high priority.

    Reply

Leave a Reply

Your email address will not be published.

To create code blocks or other preformatted text, indent by four spaces:

    This will be displayed in a monospaced font. The first four 
    spaces will be stripped off, but all other whitespace
    will be preserved.
    
    Markdown is turned off in code blocks:
     [This is not a link](http://example.com)

To create not a block, but an inline code span, use backticks: 

Here is some inline `code`.

For more help see http://daringfireball.net/projects/markdown/syntax

Or, you can subscribe without commenting.

You may subscribe to this blog by email.