================= NOTES TO OURSELVES ================

_______ RUNNING _______

To run the batch or incremental:

cd ~bfreeman/org.eclipse.dash/commits-explorer
sh update.sh
nohup sh run-incremental.sh &

To force a batch run:

nohup sh run-batch.sh &

Log files:
The insert log file is ~bfreeman/org.eclipse.dash/commits-explorer/logs/

_______ SWITCHING TO CRON _______ 

We need to switch to using cron to run this. To do so, we need to
solve the ssh problem (not needing a password).

_______ INSTALLING _______ 

1. Apache, PHP, Perl, MySQL; set query caching to 32Mbs or more
2. create the DBPASSWORD.txt file in the batch sub-directory; edit
   the dbpassword.php file in the web-api directory to reference the
   batch/DBPASSWORD.txt file
3. cron to run batch/run-incremental.sh once per day
4. web-api and web-app directories exposed through Apache

There are a few web-apis on www.eclipse.org/projects/web-api/ to support
these programs.

_______ FUTURE WORK _______ 

Haven't resolved what goes wrong with the last of the packages
of tools.cdt in the rlog parsing. Perhaps something with including
dashed lines in comments?

We also had a problem parsing org.eclipse.ui.navigator - same problem?

Use wikitect to generate the project mappings and thus allow/distribute
the maintenance to the architecture council.

Perhaps use a wiki page to maintain the type mappings.

Another wiki page idea: have a way to people to fix the bad data
issues about themselves. For example, a way to annotate that their
login id changed from darinw to dwright (i.e., that both are the same
person), and a way to annotate that person X worked for company Y
during one period and then company Z for another period, etc.

Data cubes (OLAP) often examine more than just number of transactions.
Thus one thing we could add is instead of COUNT(*) in our summaries to
do SUM(CHANGE_SIZE).

If suffixes (file types) are longer than N (12?) translate them to "none".

Tag cloud generation from comments. Animated tag clouds from comments
over time.

Include website commits from /cvsroot/org.eclipse

Do both # of commits and # of lines of change.

Keep track of data valid time and show it on the web page "data collected on XX"