Data Storage in Python - An Overview of Options (Mike Müller)

There are many possibilities in Python to store data.

This tutorials explores some of them: flat file, Excel files,

NetCDF and HDF5, serialization with pickle and friends, relational databases,

bsddb and ZODB.

The objective of this course is to give the participants an

overview over available options as well as there advantages and disadvantages

for different purposes.

Participants are strongly recommended to bring

laptops because all topics are introduced with examples and exercises.

Intended Audience

Python programmers with intermediate knowledge.

Class Outline

  • Handling flat files

  • Excel Files

    • xlrd
    • xlwt
  • NetCDF Files

    • pynetcdf
  • HDF Files

    • pyTables
    • Basics
    • Advanced features
  • Serialization

    • Marshal
    • Pickle and cPickle
    • Shelve
  • Relational Databases

    • DB API 2
    • SQLAlchemy
    • SQLObject
  • bsddb

  • ZODB

Requirements

All participants should bring laptops with Linux, Windows, or Mac OS.

Python 2.6, 2.5 or Python 2.4 need to be installed as well as an editor or IDE.

The following third-party packages are needed:

Diamond

  • Google - Diamond

Platinum

  • CCP Games - Platinum

Gold

  • Walt Disney Animation Studios - Gold
  • Net-ng - Gold
  • Socialserve.com - Gold
  • Activestate - Gold
  • White Oak Technologies Inc - Gold
  • Canonical - Gold
  • Microsoft - Gold
  • Sauce Labs - Gold
  • The Rackspace Cloud - Gold
  • ESRI - Gold
  • Oracle - Gold

Silver

  • Enthought - Silver
  • Wingware - Silver
  • Imaginary Landscape - Silver
  • Emma Email Marketing - Silver
  • Visual Numerics, Inc - Silver
  • HiiDef - Silver
  • Breadpig - Silver
  • Accense - Silver
  • Tummy - Silver
  • Zeomega - Silver

Vendor I

  • O'Reilly - Vendor I

Media

  • Linux Journal - Media
  • LinuxPro Magazine - Media
  • Ubuntu User - Media
  • CODE Magazine - Media
  • Startup Riot - Media
  • The Bit Source - Media