Data Storage in Python - An Overview of Options

There are many possibilities in Python to store data. This tutorials explores some of them: flat file, Excel files, NetCDF and HDF5, serialization with pickle and friends, relational databases, bsddb and ZODB. The objective of this course is to give the participants an overview over available options as well as there advantages and disadvantages for different purposes. Participants are strongly recommended to bring laptops because all topics are introduced with examples and exercises.

Presenter

Mike Müller lives in Leipzig, Germany and works as a consultant, programmer and trainer. He programs scientific software in Python and other languages. He teaches Python since 2004 and since 2006 at the Python Academy. His courses cover introductions to Python as well as special topics such as extensions or thread programming. Being an engineer who also works in research projects, he use numerous scientific Python packages on a daily basis and, therefore, also offers a course Python for Scientist and Engineers. He is an author of PyModelData, a Python package design for reading, writing and converting data for scientific modeling. When he does not program or teach, he spends time with his wife and his two kids or works out in the gym and runs.

Requirements

All participants should bring laptops with Linux, Windows, or Mac OS. Python 2.6, 2.5 or Python 2.4 need to be installed as well as an editor or IDE.

The following third-party packages are needed:

Class Outline

  • Handling flat files

  • Excel Files

  • NetCDF Files

  • HDF Files
    • pyTables
    • Basics
    • Advanced features
  • Serialization
    • Marshal
    • Pickle and cPickle
    • Shelve
  • Relational Databases

  • bsddb

  • ZODB

Diamond

  • White Oak Technologies Inc. - Diamond

Platinum

  • Google - Platinum
  • Sun - Platinum

Gold

  • ESRI - Gold
  • CCP Games - Gold
  • Visual Numerics, Inc. - Gold
  • Microsoft - Gold
  • Slide.com - Gold
  • Walt Disney Animation Studios - Gold

Silver

  • PSC Group - Silver
  • Enthought - Silver
  • Canonical - Silver
  • Imaginary Landscape - Silver
  • Wingware - Silver
  • ITA Software - Silver
  • Accense - Silver
  • Resolver Systems - Silver
  • Leapfrog Online - Silver
  • Emma Email Marketing - Silver
  • ZeOmega - Silver
  • Oracle Technology Network - Silver
  • VMware - Silver
  • Tummy.com - Silver

Vendor I

  • O'Reilly - Vendor I
  • Informit - Pearson Publishing - Vendor I