Quick and Dirty Intro

To use Valgrind (last verified in Sage 4.1), you should untar a fresh copy of Sage, set an environment variable, and build:

$ tar xf sage-4.1.tar
...
$ cd sage-4.1
$ SAGE_VALGRIND="yes"
$ export SAGE_VALGRIND
$ make

You may also want to change $SAGE_LOCAL/lib/python/config/Makefile to have optimization -O0 for easier to read stack traces. After doing this, you will need to do a sage -ba, of course.

After installing the Sage optional package "valgrind*," you can test interactive sessions:

$ ./sage -valgrind

or run valgrind on a set of doctests:

$ ./sage -t -valgrind devel/sage/sage/groups/perm_gps/

(Note that currently the "valgrind" option cannot be the first argument.)

Once the session is finished, the results can be found in $HOME/.sage/valgrind/. Each file can be searched for phrases like "definitely lost" or "conditional jump", and the stack traces give line numbers in the generated C source (remember to look up that line number in the .c file and use that to figure out which line it is in the .pyx file).

Also note that if you want to test components, you may need to add the --trace-children=yes option to the MEMCHECK_FLAGS line in $SAGE_LOCAL/bin/sage-valgrind script.

Introduction

Sage 2.8.5 and later supports a number of valgrind tools:

Valgrinding Sage is difficult because it runs on top of Python which poses a number of challenges compared to pure C/C++ code. Run

sage -optional

to see the list of optional packages. You should install the valgrind.spkg with the highest revision number.

Valgrind Version

As of Sage 3.1.2, Valgrind 3.3.1 is available as an optional package.

Known Issues With Sage Components

valgrind: m_mallocfree.c:209 (get_bszB_as_is): Assertion 'bszB_lo == bszB_hi' failed.
valgrind: Heap block lo/hi size mismatch: lo = 100000048, hi = 280100984.
Probably caused by overrunning/underrunning a heap block's bounds.

Using callgrind with Sage

callgrind is a powerful profiler that is part of valgrind (but it slows down your program a lot). Just do sage -callgrind to run Sage under callgrind; this will produce files callgrind.out.nnnn in $SAGE_ROOT/local/bin that can be interpreted by callgrind_annotate or by kcachegrind. (A single run of Sage will create multiple files, one for each process involved. That is, one for Sage, one for Singular, etc...)

To profile only part of a Sage run, edit $SAGE_ROOT/local/bin/sage-callgrind and add the flag --instr-atstart=no to the valgrind command line (before python -i). Then run sage -callgrind, and do whatever setup until you're ready to start profiling. In another window, run callgrind_control -i on, then press Enter in your Sage window. Now do whatever you want profiled. When that's completed, go back to your other window, run callgrind_control -i off, then press Enter in your Sage window again.

The default settings for callgrind do not interact well with Cython-generated code--it will assume that each call to PyEval_CallObjectWithKeywords is equally costly. To get callgrind to differentiate calls by their caller, add --seperate-callers=10 to $SAGE_ROOT/local/bin/sage-callgrind.

Preliminary Presentation

More to come at SD6. But: SageDays5_preliminary_valgrind_talk.pdf

Interesting Experimental Valgrind Tools/Components

Getting Chronicle to work with 3.3.0trunk

The following info was supplied by Carl Witty:

To create my (apparently working) chronicle tree:

Check out svn revision 51 of chronicle-recorder
move chronicle/valgrind/chronicle out of the way somewhere
remove chronicle/valgrind
replace chronicle/valgrind with r6959 of valgrind, from valgrind-3.3.0svn-r6959
apply the patch sage.math:/home/cwitty/valgrind-r6959-to-chronicle.patch 
    to this replaced valgrind directory
move chronicle/valgrind/chronicle back under the (new) valgrind directory
apply the patch sage.math:/home/cwitty/chronicle-r51-to-chronicle.patch
    to the chronicle/valgrind/chronicle directory

ToDo

ValgrindingSage (last edited 2017-06-13 00:16:23 by saraedum)