CMPLXSYS 530 - Computer Modelling of Complex Systems

Course information

Course time & location

Tuesdays and Thursdays, 1 - 2:30pm
Zoom link: https://umich.zoom.us/j/93007166734

Instructor & office hours

Prof. Marisa Eisenberg (she/her)
Email: marisae@umich.edu
Office Hours
- Tuesdays & Thursdays after class - 2:30 - 3:30 on Tuesdays, 2:30 - 3pm on Thursdays
- Additional office hours by appointment
- Same zoom link as class

Syllabus

Syllabus - includes course overview, grading information, prerequisites, etc.

HW/Lab information

HW/Lab guidelines - guidelines on how to turn in your HW assignments, what needs to be turned in, and the grading rubric we will use. Note that assignments are turned in via Canvas!
Final project information - information on the course final project (will be updated as we go)
Final project proposal template

Course topics

Topics are subject to change and rearrangement! (We may also not get through all the topics listed)

Lecture slides, links to assignment instructions, and readings will be posted in each topic as we get to them.

1. Introduction to agent-based models (ABMs)

Topics covered: overview of basic concepts, coding intro, why model?, intro to ABMs and their pros/cons, philosophy of complex systems, emergent behavior/phenomena, classic examples in biological, social, and physical systems, etc.

Lecture 1: Introduction and overview (1/19/21)
- Slides - what are models, why model, emergent behavior, complex systems
- Readings
- To Do: install python (e.g. the Anaconda distribution) and NetLogo - see the Additional useful info section below for tutorials and more info!

Lecture 2: Introduction to Agent-Based Models (1/21/21)
- Slides - how to choose a modeling framework, intro to ABMs
- Emoji simulator: forest fire model, blank model, more models!
- Readings
  - Think Complexity, Chp. 1

Lecture 3/Lab 1: Examples & Features of Agent-Based Models (1/26/20)
- Slides (continued from last time)
- Quick intro to NetLogo
- Lab 1: Introduction to ABMs, NetLogo, and Python
  - For emoji, you can copy-paste from here: https://emojipedia.org/
- Readings
  - Wilensky and Rand, Chp. 2
  - Considerations and Best Practices in Agent-Based Modeling to Inform Policy (gives a nice introduction to the PARTE framework for thinking about ABMs)

Intro to the PyCX library for simulating complex systems models in Python (1/23/20)
- Intro to PyCX (pdf version)
- Download from the PyCX GitHub
- PyCX model template script
- Readings
  - Sayama, Chp. 10
  - Sayama, H. (2013). PyCX: a Python-based simulation code repository for complex systems education. Complex Adaptive Systems Modeling, 1(1), 1-10.

Lecture 4/Lab 1: Case study: Modeling the Ancestral Puebloan communities of Long House Valley (the Artificial Anasazi Project (AAP)) / Continue Lab 1 (2/2/21)
- Slides
- Continue Lab 1
- Readings
  - Papers on the AAP (see also the references in the slides)
    - Axtell et al., PNAS, 2002. Population growth and collapse in a multiagent model of the Kayenta Anasazi in Long House Valley
    - An interesting replication study that examines some of the issues and underpinnings of the AAP: Janssen, JASSS, 2009. Understanding Artificial Anasazi
  - Broader reading on ABMs (for Lab 1): Wilensky and Rand, Chp. 3-4

2. Cellular automata

Topics covered: overview of basic cellular automata (CA) concepts, emergent behavior, classes of CA, examples of CA (e.g. Conway’s Game of Life), coding and analysis methods for CA, applications

Lecture 5: Intro to cellular automata (1/28/20)
- Slides
- Readings
  - Sayama, Chp. 11
  - Think Complexity, Chp. 6
- Miscellaneous
  - COVID Cellular Automata model
  - Cellular Automata used for a herd immunity explainer on NPR
  - Visualizing 3D, 4D, and 5D Cellular Automata (Thanks to Saisamrit Surbehera for sharing this!)

Extra Notes: Chaos Game!
- Board notes
- Interesting links & extra things
  - Chaos game simulator - lets you try out chaos games with other shapes and settings, also includes some proofs for why the Chaos Game works
  - A somewhat systematic exploration of some chaos game simulations
  - Barnsley fern
  - Sierpinski Tetrahedrons
  - Neat fractal landscapes

Lecture 6: Cellular automata dynamics (1/30/20, wrap up 2/4/20)
- Slides
- Code
- Readings
  - Sayama, Chp. 12
  - Think Complexity, Chp. 7

Lab 2 (Posted 2/16/21, due 2/25/21)
- Lab 2: Cellular Automata & Intro to Networks
- A collection of 1-dimensional cellular automata
- Basic commands for networks in NetworkX/Python and NetLogo
- NetworkX tutorial (from the NetworkX documentation)
- Network data from Mark Newman

3. Networks

Lecture 7: Introduction to Networks (2/23/21)
- Slides
- Readings

Lab 2 (posting here also, since it includes networks)
- Lab 2 Instructions
- A collection of 1-dimensional cellular automata
- Basic commands for networks in NetworkX/Python and NetLogo
- NetworkX tutorial (from the NetworkX documentation)
- Network data from Mark Newman

Lecture 8: Random networks, dynamics on networks and of networks (2/13/20 and 2/18/20)
- Slides
- Code
- Readings
  - Sayama, Chp. 16
  - Think Complexity, Chp. 4 and 5

Lecture 9: Adaptive networks, mean-field approximation of networks (3/2/21 - 3/18/21)

Lab 3 (Posted 3/16/21, due 3/23/21)
- Lab 3: Dynamics on and of Networks

4. Parameter sweeps, sampling, and sensitivity analysis

Lecture 10: Sampling, visualization, uncertainty (3/25/21)
- Slides
  - Example code - Latin hypercube sampling with an SIR network model
- Readings
  - PARTE (Properties, Actions, Rules, Time, Environment) framework
  - ODD (Overview, Design concepts, and Details) Protocol
  - Yang Y, Roux AV, Auchincloss AH, Rodriguez DA, Brown DG. A spatial agent-based model for the simulation of adults’ daily walking within a city . American journal of preventive medicine. 2011 Mar 1;40(3):353-61.

Lecture 11: Sensitivity analysis (3/30/21)
- Slides
- Readings
  - Marino, Simeone, et al. “A methodology for performing global uncertainty and sensitivity analysis in systems biology.” Journal of theoretical biology 254.1 (2008): 178-196.
  - A nice table of different sensitivity analysis methods
  - The wikipedia page is also pretty comprehensive!
  - Active nonlinear testing

Lecture 12: Model Analysis (4/1/21)
- Slides

Lab 4 (Posted 3/31/21, due 4/15/21)
- Lab 4: Parameter sampling and sensitivity
- Replit lab template: https://replit.com/@EisenbergUM/CSCS530-Lab4#main.py - you can fork this to make your own lab, run PyCX, and share your code to collaborate. It’s a new tool for me but hopefully useful!
- Google doc sign up sheet for project proposal peer review
- Google drive link for uploading your project proposal (or you can share via box/dropbox/overleaf/email—see instructions in the sign up sheet link above!)

5. Advanced/additional topics

Potential Topics:
- parameter estimation, MCMC
- parameter identifiability & uncertainty
- model comparison (e.g. AIC/BIC/etc)
- introductory decision/game theory
- parallelization in Python
- classic example complex systems models (Kuramoto oscillators, Sugarscape, etc.)
- more advanced environments (e.g. GIS)
- active subspaces, dimension reduction (not sure if there will be time)

Lecture 13: Introduction to parameter estimation (4/6/21)
- Thinking about the challenges of linking data with models, and what these approaches can (and can’t) tell you
- Slides

Lecture 14: Introduction to Bayesian parameter estimation & MCMC
- Sampling based methods, including basics of approximate Bayesian computation, sample importance resampling, MCMC (Markov Chain Monte Carlo), etc.
- Slides
- Readings
  - Menzies NA, Soeteman DI, Pandya A, Kim JJ. Bayesian methods for calibrating health policy models: a tutorial. PharmacoEconomics. 2017 Jun 1;35(6):613-24.
- Example code
  - Maximum likelihood
  - MCMC

Lecture 15: Game & decision theory (4/13/21)
- Slides
- Readings
  - Nicky Case’s The Evolution of Trust Explorable
  - Axelrod & Hamilton, The Evolution of Cooperation
  - Further reading on iterated prisoner’s dilemma
  - Parikh et al, 2012 - super interesting paper on behavioral dynamics after disasters (Thanks to Jessie Conrad for sharing!)

Lecture 16: Identifiability
- Slides

Lecture 17: Parallel Computing (4/20/21)
- Slides
- Replit Example Code
- Additional tools for more advanced parallel computing:
  - https://numba.pydata.org/
  - https://dask.org/
- Some info on the difference between map_async and imap

Lecture 18: ABM Environments
- Slides
- Mapping tutorials
  - Making 3 Easy Maps in Python - the point map example here may be particularly useful for visualizing agents on a map (where you can define their x,y locations in terms of e.g. latitude and longitude). This uses the module folium, which is one of the common mapping packages.
  - Making maps in Basemap This is another package for mapping, and you can similarly do point maps and plot other features on the map. The syntax for basemap seems pretty straightforward, so this may be a useful package to consider also. There’s an additional tutorial for Basemap here also.

Additional useful info

Useful links and extra readings will be posted here.

Coding and typesetting resources

Overall Coding Resources

NetLogo installation information
Python
- Anaconda distribution for Python
- Tutorials
  - 10-minute Python - very short tutorial with just the basics (often useful if you’ve coded in other things or have used python but not in a while)
  - The Python Tutorial - the official tutorial, gives more details and a good reference. Good to start with if you’ve never used python.
  - Think Python - the book is a good reference too—you may want to start with Chapters 2 and 3
  - A nice collection of python tutorials
- Spyder - the built in tutorial is pretty good! You can find it under the help menu
- Jupyter/IPython resources
  - Jupyter notebook site, a nice tutorial on using Jupyter notebooks
R and Rmarkdown Resources (if you’re an R person)
- R and RStudio for R
- Rmarkdown: useful for writing up lab assignments quick tour, longer intro, Rmarkdown complete guide

ABM Resources

Modules/packages for agent-based modeling
- PyCX module for Python (we will use this!) (reference for PyCX)
- Mesa framework similar to the commonly used ABM package Repast but for Python (I’ve not used this before but looks interesting)
- SpaDES package for R (I’ve not used this before but looks interesting)
- CoMSES ABM Library - potentially useful for project ideas!

Math Resources

Typesetting math: \(\LaTeX\) resources from Paul Hurtado

Books used in the course

Introduction to the Modeling and Analysis of Complex Systems by Hiroki Sayama
Think Complexity by Allen Downey
Think Python by Allen Downey
An Introduction to Agent-Based Modeling by Uri Wilensky and William Rand (you may need to be on the UM network or connected to the VPN for the download to work)

Interesting papers and extra readings

Ostrom, 1988 - Computer Simulation: the Third Symbol System