To-Do and Wish List

High Priority
  • Cluster configuration file standard definition
    • Adapting various clients (genmachines / threads) to make use of cluster definition file
  • Add large (~1 TB) dataset with variety of modes on Data Fabric (CR)
    • Regression testing scripts
  • Make general version of NRAO Monitoring GUI, with generic database backend (USNO)
  • Choose framework for unit testing. Implement test cases (JM)
  • az/el in the calc file, + parallactic angle?
  • Amplitude correction for primary beam effects for multifield projects
  • Support for VDIF on module directories
  • Restarting a correlation that has died mid-job
  • Support for zoom band in vex2difx, difx2fits, difxio (WB)
Medium Priority
  • Certifying that non-power-of-2 FFTs works
  • vex2difx (or other) support for creating .machines and .threads (from the eVLBI perspective)
  • Add DiFX diagnostics
  • Storing the original pointing source somewhere in the FITS file (plus the attendant AIPS changes)
  • DiFX with ASKAP data (CP)
  • Add an option in startdifx to loop/wait for a module insertion if it is missing
  • Add per-IF phase polynomial in the calc file (and delay polynomial, too?)
  • Documentation
    • Doxygen of mpifxcorr source - automatically installed locally, also someone mirror to a webserver
    • Documentation of mpifxcorr internals (buffers etc.)
  • Documentation Algorithms
    • parameter optimisation (AD)
    • monitoring, etc - (list of error codes) (AD)
    • setting up native Mark5 access (WB+)
  • evlbi
    • reconnection/long term drop-outs (CP)
    • real-time delay/rate adjustment (CP)
  • vex2difx to create an input file setup to be used with vlbi_fake
  • Synchronize data fabric test datasets at several sites. (Bonn, Curtin, NRAO)
  • Maintain database of benchmarking results (JM)
  • Phased array (RS, CR).
  • visplot (Aquib)
  • Investigate sampler stats monitoring (AD/WB/CP)
  • subband distribution/parallelisation (with VDIF) (AD/CP)
    • replumbing/refactoring vex2difx setup
  • Play back from both Mk5 banks in parallel (WB)
  • Transition to using band centres instead of band edges (WB)
  • Baseband data generator for producting test datasets. (WB)
  • Parallelised calc server / Efficiency gains in CALC (same time, different sources etc)
  • Store polynomial tau(l, m) generalized delay model in FITS (WB,JM)
  • Standard way of setting up environment (JM)
  • Have different environments for building and operation (GC)
  • Resurrect the tweakIntTime option
  • Chase up and eliminate the cause of occasional “Somehow Visibility X ended up with Y+1 subintegrations - was expecting only Y” errors
  • Mixed module and file list on one station
  • Investigate whether changing maxReadSize to 8MB (or going to 8 MB subreads) fixes the Bonn problem
  • Restitching contiguous zoom bands into wider bands (e.g. for ALMA)
Low Priority
  • Refactoring the mpifxcorr/mk5daemon libraries and merging functionality
  • Move to a binary format for pcal files and name by datastream not by antenna name
  • vex2 support (relies on vex2 finalization and some support from field systems)
  • On-the-fly application of calibration (bandpasses etc) with appropriate accountability
  • Modernize sniffer
  • cleanup of DiFX error messages
  • Single process multi-threaded non-mpi program for DiFX-specific CPU benchmarking.
  • Future proofing via non-prescriptive format (AD)
  • K5 format support (CP)
  • Space VLBI
    • Orbit model
    • Baseline dependent averaging
  • eVLBI gui
  • IPP alternatives
  • Generic startup scripts (CR)
    • Documentation of startup philosophy
  • Shifted FT (moving channel boundary to edge of band) (AD)
  • DiFX2fits uv shifting in trunk (JM/AD)
  • Migrating to python3.0 (ensure current compatibility with python2.6) (everyone)
  • Add support for crosscorrelation of non matching sample rates
  • SVN cleanup
  • Auditing / refactoring the amplitude scaling
  • pulsar predictor support in “polyco”
  • Get rid of printing to screen in mark5access (change to be called and printed from elsewhere)
  • Get Eric to improve AIPS PCAL (multi tone)
  • Improve the runtime predictor (make better use of the new cluster configuration file, better estimate true load)
  • Review DiFX installation (SCONS, autotools etc.) (JM)

Old lists

Old list from DiFX meeting in Socorro, Oct 2010

Old list from DiFX meeting in Perth, Sep 2009

Old list from DiFX meeting in Bonn, Sep 2008

Old list (from DiFX meeting in Bonn, 13&14 Sep 2007)

difx/todo.txt · Last modified: 2011/12/10 06:02 by adamdeller
 
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Noncommercial-Share Alike 3.0 Unported
Recent changes RSS feed Donate Powered by PHP Valid XHTML 1.0 Valid CSS Driven by DokuWiki