Differences between revisions 36 and 86 (spanning 50 versions)

This page aims to keep information public about Sage's infrastructure. Question mark means that the information is not confirmed, please edit if you know more... and note the date of your update so that current and stale information can be distinguished.

Please mark which services still need to find a new home, with the system requirements and the deadline.

Contents

Current services
Defunct services
1. sagenb.org
2. sageb0t

Current services

DNS

registrant: was
admin: was, schilly
tech contact: was, schilly

ask.sagemath.org

purpose: webserver where users can get support
hosted at: LIPN (CS lab), University Paris North (Villetaneuse)
contact: [email protected]
url: https://ask.sagemath.org
admin: tmonteil
local sage dev: tmonteil
technology used: unprivileged LXC, debian, nginx, uwsgi, postgesql, askbot
issues : upgrade askbot to further versions is pretty painful (broken database migration scripts)
formerly hosted at: Ohio State University (thanks !)
- resources needed: database on a separate VM, 2GB RAM, 10GB disk
- admin: niles, tmonteil
- local tech contact: David Alden, Josh Carroll
- technology used: ubuntu, nginx, uwsgi, postgesql, askbot
- there are two machines : ask-sagemath and ask-sagemath-db

backup

purpose: keep the data of various services in a separate place
hosted at: Mathematics lab, Université Paris Sud (Orsay)
technology used: debian, rsync, cron
resources needed: 1TB disk
admin: tmonteil, slelievre
local sage dev: slelievre
local tech contact: Mathilde Rousseau
currently keeping a daily backup of :
- https://ask.sagemath.org
- https://wiki.sagemath.org

doc.sagemath.org, planet.sagemath.org, www.sagemath.org

purpose: on-line browsable documentation + web homepage
hosted at: github.io
technology used: proprietary
resources needed: 0 CPU, 0 RAM, 0 DISK
admin: everyone who is on the github group for sagemath
contact: schilly for the website
url: https://doc.sagemath.org https://planet.sagemath.org https://www.sagemath.org

files.sagemath.org, fileserver.sagemath.org, old.files.sagemath.org

purpose: main files, spkgs, and backup of "other" files
what's at files.sagemath.org is exactly rsync.sagemath.org::sage
old.files.sagemath.org has the old stable releases
are the old development tarballs are still archived somewhere?
hosted at: UW. Other places are the mirrors of it.
contact: schilly, vbraun
admin: ohanar?
url: http://files.sagemath.org http://fileserver.sagemath.org http://old.files.sagemath.org

git.sagemath.org, trac.sagemath.org

purpose: development tools, they share the same host
hosted at: google ?
technology used: ubuntu, apache, git, trac
resources needed: ?CPU ?RAM ?DISK
admin: people with root access: kclawson, ohanar, vbraun, mderickx, robertwb, wstein, dimpase
contact: no real organisation yet, go to sage-devel
url: https://git.sagemath.org https://trac.sagemath.org

GitHub organization for SageMath

url: https://github.com/sagemath
admin: schilly, vbraun

GitLab organization for SageMath

url: https://gitlab.com/sagemath
admin: embray, jrueth

build.sagemath.org

purpose: distribute and gathers automatic binary building on volunteer's machines
hosted at: University of Washington
technology used: ubuntu, nginx; using using the continuous integration framework of http://buildbot.net/
resources needed: ?CPU ?RAM ?DISK
admin: ??
contact: ??
url: http://build.sagemath.org

patchbot.sagemath.org

purpose: distribute and gathers automatic ticket testing on volunteer's machines
hosted at: IRMA, Université de Strasbourg
technology used: ubuntu, nginx, uwsgi, flask, mongodb, see patchbot for more details
application source code: https://github.com/sagemath/sage-patchbot
resources needed: Minimal CPU, RAM. ~50GB disk.
admin: chapoton, tmonteil
root access: chapoton, tmonteil
contact: chapoton, tmonteil
local sage dev: chapoton
local tech contact: Alain Sartout
url: https://patchbot.sagemath.org

rsync.sagemath.org

purpose: the seed for mirrors, see MirrorNetwork for more details
hosted at: University of Washington
technology used: rsync
resources needed:
- CPU 1 core
- RAM 2-3 GB (mostly for caching when calculating hashes)
- DISK enough for all sage files (50+ GB)
admin: schilly
contact: schilly
url: http://rsync.sagemath.org

sagecell.sagemath.org

purpose: allow embedding sage computations within a webpage
hosted at:
- www.uni-frankfurt.de (Frankfurt, Germany)
- Universidad Autónoma de Madrid (Madrid, Spain)
- Google Compute Engine (Council Bluffs, Iowa, USA)
technology used: production installation requires a dedicated server (either physical or virtual)
resources needed:
- RAM: 32GB recommended for smooth operation, 16GB may become enough in the future
- CPU: the more the better for handling spikes in load and allowing parallel interacts, but any will do if necessary
- DISK: must have BTRFS at least for /var/lib/lxc, SSD is preferable, 100GB should be sufficient for the foreseeable future
admin: novoselt
contact: novoselt
available urls: http://aleph.sagemath.org, https://sagecell.sagemath.org

wiki.sagemath.org

purpose: the wiki you are reading!
hosted at: LIPN (CS lab), University Paris North (Villetaneuse)
contact: [email protected]
url: https://wiki.sagemath.org
admin: tmonteil
local sage dev: tmonteil
technology used: unprivileged LXC, debian, nginx, certbot, uwsgi, moinmoin, jsmath, docutils
formerly hosted at: cloud.google.com
possible issue in migration: the database of user accounts is synced from trac when this latter is modified (incron)

zulip.sagemath.org

purpose: chat system
hosted at: cloud.google.com
resources needed: a dedicated VM with 2-4GB of RAM
admin: roed, jrueth (saraedum) - as of 2020-05.

DockerHub organization

purpose: distribute SageMath Docker images
hosted at: https://hub.docker.com/u/sagemath/
admin: embray, jrueth
other: slelievre also has push access

Defunct services

sagenb.org

purpose: public notebook,
state: end of life; redirects to CoCalc
volunteers to provide worksheets back to the users: dimpase, tmonteil, vdelecroix

sageb0t

purpose: turn pull requests on GitHub into trac tickets
contact: robertwb

-  ⇤ ← Revision 36 as of 2016-01-27 00:56:54 → 
  Size: 6508
  Editor: slelievre
  Comment: Add Sage-on-Gentoo repository
+   ← Revision 86 as of 2022-04-22 18:28:39 → ⇥
  Size: 7090
  Editor: mkoeppe
  Comment: sageb0t is defunct
-Deletions are marked like this.
+Additions are marked like this.
 Line 2:
-Question mark means that the information is not confirmed, please edit if you know more.
+Question mark means that the information is not confirmed, please edit if you know more... and '''note the date of your update''' so that current and stale information can be distinguished.
 Line 5:
+<<TableOfContents()>>
-Line 14:
+Line 16:
-  * purpose: webserver wher users can get support
  * hosted at: Ohio State University (Niles Johnson's university)
  * technology used: ubuntu, nginx, uwsgi, postgesql, askbot
  * resources needed: database on a separate VM, 2GB RAM, 10GB disk
  * admin: niles, tmonteil, vedlecroix, slelievre, kcrisman, mhansen
+  * purpose: webserver where users can get support
  * hosted at: [[https://lipn.univ-paris13.fr/|LIPN (CS lab)]], University Paris North (Villetaneuse)
-Line 20:
+Line 19:
+  * url: https://ask.sagemath.org
  * admin: tmonteil
  * local sage dev: tmonteil
  * technology used: unprivileged LXC, debian, nginx, uwsgi, postgesql, askbot
  * issues : upgrade askbot to further versions is pretty painful (broken database migration scripts)
  * formerly hosted at: [[https://www.osu.edu/|Ohio State University]] (thanks !)
    * resources needed: database on a separate VM, 2GB RAM, 10GB disk
    * admin: niles, tmonteil
    * local tech contact: David Alden, Josh Carroll
    * technology used: ubuntu, nginx, uwsgi, postgesql, askbot
    * there are two machines : ask-sagemath and ask-sagemath-db
-Line 21:
+Line 31:
-== build.sagemath.org ==
  * purpose: distribute and gathers automatic binary building on volunteer's machines
  * hosted at: ?UW?
  * technology used: ubuntu, nginx: see [[buildbot]] for more details
  * resources needed: ?CPU ?RAM ?DISK
  * admin: ??
  * contact: ??
-Line 29:
+Line 32:
-== cloud.sagemath.com ==
  * what: a cloud service for computation and collaboration
  * operated by: Sagemath, Inc
  * url: http://cloud.sagemath.com
+== backup ==
  * purpose: keep the data of various services in a separate place
  * hosted at: [[https://www.math.u-psud.fr/?lang=fr|Mathematics lab]], Université Paris Sud (Orsay)
  * technology used: debian, rsync, cron
  * resources needed: 1TB disk
  * admin: tmonteil, slelievre
  * local sage dev: slelievre
  * local tech contact: Mathilde Rousseau
  * currently keeping a daily backup of :
    * https://ask.sagemath.org
    * https://wiki.sagemath.org
-Line 41:
+Line 52:
+  * url: https://doc.sagemath.org https://planet.sagemath.org https://www.sagemath.org
-Line 42:
+Line 54:
-== dockerhub ==
  * purpose: docker container for SageMath
  * url: https://hub.docker.com/u/sagemath/
  * admin: vbraun, sebasguts

== files.sagemath.org, old.files.sagemath.org ==
+== files.sagemath.org, fileserver.sagemath.org, old.files.sagemath.org ==
-Line 55:
+Line 62:
+  * url: http://files.sagemath.org http://fileserver.sagemath.org http://old.files.sagemath.org
-Line 58:
+Line 66:
-  * hosted at: ?UW?
+  * hosted at: google ?
-Line 61:
+Line 69:
-  * admin: ?
  * contact: ?
+  * admin: people with root access: kclawson, ohanar, vbraun, mderickx, robertwb, wstein, dimpase
  * contact: no real organisation yet, go to sage-devel
  * url: https://git.sagemath.org https://trac.sagemath.org
-Line 65:
+Line 74:
-  * url: http://github.com/sagemath
+  * url: https://github.com/sagemath
  * admin: schilly, vbraun

== GitLab organization for SageMath ==

  * url: https://gitlab.com/sagemath
  * admin: embray, jrueth

== build.sagemath.org ==
  * purpose: distribute and gathers automatic binary building on volunteer's machines
  * hosted at: University of Washington
  * technology used: ubuntu, nginx; using using the continuous integration framework of http://buildbot.net/
  * resources needed: ?CPU ?RAM ?DISK
-Line 67:
+Line 88:
+  * contact: ??
  * url: http://build.sagemath.org
-Line 70:
+Line 93:
-  * hosted at: ?UW?
  * technology used: centos, custom flask, mongodb, see [[buildbot]] for more details
  * resources needed: Minimal CPU, RAM. ~25GB disk.
  * admin: robertwb, chapoton
  * contact: robertwb, chapoton

== Packaging for Linux ==

=== arch-linux package ===
  * purpose: easy-to-install arch-linux package
  * maintainer: Antonio Rojas
  * hosted at: https://www.archlinux.org/packages/community/x86_64/sagemath/

=== Fedora package ===
  * purpose: easy-to-install Fedora package
  * maintainer: Paulo Cesar Pereira de Andrade (pcpa)
  * hosted at: https://apps.fedoraproject.org/packages/sagemath
  * other link: https://fedoraproject.org/wiki/SIGs/SciTech/SAGE

=== Gentoo: Sage-on-Gentoo ===
  * repository: https://github.com/cschwan/sage-on-gentoo
  * admin: fbissey, cschwan

=== RPM package ===
  * what: links to sagemath packages for the rpm package manager (Fedora, Mandriva)
  * hosted at: http://rpmfind.net/linux/rpm2html/search.php?query=sagemath

=== Ubuntu PPA ===
  * purpose: easy-to-install Ubuntu .deb packages
  * hosted at: launchpad.net
  * admin: pipedream
  * contact: https://launchpad.net/~aims/+archive/ubuntu/sagemath
+  * hosted at: [[https://irma.math.unistra.fr/|IRMA]], [[http://www.unistra.fr|Université de Strasbourg]]
  * technology used: ubuntu, nginx, uwsgi, flask, mongodb, see [[patchbot]] for more details
  * application source code: https://github.com/sagemath/sage-patchbot
  * resources needed: Minimal CPU, RAM. ~50GB disk.
  * admin: chapoton, tmonteil
  * root access: chapoton, tmonteil
  * contact: chapoton, tmonteil
  * local sage dev: chapoton
  * local tech contact: Alain Sartout
  * url: https://patchbot.sagemath.org
-Line 105:
+Line 106:
-  * hosted at: UW
+  * hosted at: University of Washington
-Line 109:
+Line 110:
-     * RAM 2-3 gb (mostly for caching when calculating hashes)
+     * RAM 2-3 GB (mostly for caching when calculating hashes)
-Line 113:
+Line 114:
+  * url: http://rsync.sagemath.org
-Line 117:
+Line 119:
-    * Goethe-Universität (Frankfurt, Germany)
    * Universidad Autónoma de Madrid (Madrid, Spain)
+    * [[Goethe-Universität|www.uni-frankfurt.de]] (Frankfurt, Germany)
    * [[https://www.uam.es|Universidad Autónoma de Madrid]] (Madrid, Spain)
-Line 127:
+Line 129:
-  * available urls: http://aleph.sagemath.org, http://sagecell.sagemath.org
+  * available urls: http://aleph.sagemath.org, https://sagecell.sagemath.org

== wiki.sagemath.org ==
  * purpose: the wiki you are reading!
  * hosted at: [[https://lipn.univ-paris13.fr/|LIPN (CS lab)]], University Paris North (Villetaneuse)
  * contact: [email protected]
  * url: https://wiki.sagemath.org
  * admin: tmonteil
  * local sage dev: tmonteil
  * technology used: unprivileged LXC, debian, nginx, certbot, uwsgi, moinmoin, jsmath, docutils
  * formerly hosted at: cloud.google.com
  * possible issue in migration: the database of user accounts is synced from trac when this latter is modified (incron)

== zulip.sagemath.org ==
  * purpose: chat system
  * hosted at: cloud.google.com
  * resources needed: a dedicated VM with 2-4GB of RAM
  * admin: roed, jrueth (saraedum) - as of 2020-05.

== DockerHub organization ==
  * purpose: distribute SageMath Docker images
  * hosted at: https://hub.docker.com/u/sagemath/
  * admin: embray, jrueth
  * other: slelievre also has push access

= Defunct services =
-Line 131:
+Line 158:
-  * state: end of life, replaced by [[http://cloud.sagemath.com]]
  * volunteers: dimpase, tmonteil, vdelecroix
+  * state: end of life; redirects to [[https://cocalc.com/|CoCalc]]
  * volunteers to provide worksheets back to the users: dimpase, tmonteil, vdelecroix
-Line 134:
+Line 161:
-== social networks ==

=== Facebook ===
  * url: https://www.facebook.com/Sage-Math-26593144945/
  * admin: harald

=== Google+ ===
  * url: https://plus.google.com/+sagemath
  * admin: harald

=== Twitter ===
  * url: https://twitter.com/sagemath
  * admin: harald

== wiki.sagemath.org ==
  * purpose: the wiki you are currently reading!
  * hosted at: ?UW?
  * technology used: ubuntu, apache, moinmoin
  * resources needed: ?CPU ?RAM ?DISK
  * admin: ?
  * contact: ?
  * possible issue in migration: it share the same db of users acounts than trac.


= Planned services (wishlist) =

schilly: who wishes this and did define those purposes based on what discussion?

== backup ==
  * purpose: backup between remote hosts, local backups can be destroyed
     * schilly: backup of what?

== stats ==
  * purpose: stop feeding google-analytics database
    * schilly: strong objection, we have a long time history stored there and it's far better than any other tools
  * public stats are here [[http://www.histats.com/viewstats/?SID=1579950&f=2]]
    * novoselt: horrific page - I thought such blinking adds are a thing of the past, had to close it before finding any data

== lists ==
  * purpose: do not depend on googlegroups (see what happened with googleID on ask and sagenb)
     * schilly strong objection: what has this to do with google id?
+== sageb0t ==
  * purpose: turn pull requests on !GitHub into trac tickets
  * contact: robertwb

Diff for "Infrastructure"