Objective

This chapter provides an overview of data warehouses and familiarizes the readers with the terminologies and concepts of data warehouses. The chapter further focuses on the transformation of data warehousing techniques from past to present to future, and how it impacts building a modern data warehouse.

After studying this chapter, you should be able to do the following:

•    Understand the basics of data warehousing, from the tools, processes,and techniques used in modern-day data warehousing to the different roles and responsibilities of a data warehouse team.

•    Set up a synergy between engineering and operational communities,even when they’re at different stages of learning and implementation maturity.

•    Determine what to adopt and what to ignore, ensuring your team stays up to date with the latest trends in data warehousing.

Whether you’re starting a data warehouse team or just looking to expand your knowledge, this guide is the perfect place to start. It will provide you with a background on the topics covered in detail in further chapters, allowing you to better understand the nuances of data warehousing and become an expert in the field.

Origin of Data Processing and Storage in the Computer Era

The history of data processing and storage dates back to the early 20th century when mechanical calculators were used for basic arithmetic operations. However, it wasn’t until the mid-20th century that electronic computers were developed, which revolutionized data processing and storage.

The first electronic computer, the ENIAC (Electronic Numerical Integrator and Computer), was built in 1946 by J. Presper Eckert and John Mauchly. It was a massive machine that filled an entire room and used vacuum tubes to perform calculations. ENIAC was primarily used for military purposes, such as computing artillery firing tables.

In the 1950s and ’60s, the development of smaller and faster transistors led to the creation of smaller and more efficient computers. The introduction of magnetic tape and magnetic disks in the late 1950s allowed for the storage of large amounts of data, which could be accessed much more quickly than with punched cards or paper tape.

In the 1970s, the development of integrated circuits (ICs) made it possible to create even smaller and more powerful computers. This led to the development of personal computers in the 1980s, which were affordable and accessible to a wide range of users.

Today, data processing and storage are essential to nearly every aspect of modern life, from scientific research to business and commerce to entertainment. The rapid growth of the modern storage solution powered by SSD and flash memory and by internet and cloud computing has made it possible to store and access vast amounts of data from almost anywhere in the world.

In conclusion, the origin of data processing and storage can be traced back to the early 20th century, but it wasn’t until the development of electronic computers in the mid-20th century that these processes became truly revolutionary. From massive room-sized machines to powerful personal computers, data processing and storage have come a long way and are now essential to almost every aspect of modern life.