Keep track of your computer activity throughout the day: visualize your active window titles and the number of keystrokes in beautiful HTML timelines. Current features:
- Records your active window title throughout the day
- Records the frequency of key presses throughout the day
- Record custom note annotations for particular times of day, or for day in general
- Everything runs completely locally: none of your data is uploaded anywhere
- Beautiful, customizable UI in HTML/CSS/JS (d3js).
The project currently only works on Ubuntu and OSX, and uses new fancy Promises feature of ECMAScript 6. This might not be implemented in all browsers. My Chrome has it, but for example my Firefox doesn't.
See a blog post (along with multiple screenshots) describing the project here.
To start recording
- Clone the repository to some folder:
$ git clone https://github.com/karpathy/ulogme.git - If you're on Ubuntu, make sure you have the dependencies:
$ sudo apt-get install xdotool wmctrl. On Fedora, you may also needsudo yum install gnome-screensaver. cdinside and run$ ./ulogme.sh(note: this will ask you for sudo authentication which is required forshowkeycommand). This will launch two scripts. One records the frequency of keystrokes and the other records active window titles. Both write their logs into log files in thelogs/directory. Every log file is very simply just the unix time stamp followed by data, one per line.- For OSX only: there might be an additional step where you have to go to System Preferences > Security & Privacy > Accessibility, and make sure that Terminal (or iTerm2, or whatever you use to launch ulogme) is checked. If it wasn't checked previously and you just checked it, you may need to restart ulogme. If you don't do this step, you might find that window logging works but keypress logging doesn't.
The user interface
- Important. As a one-time setup, copy over the example settings file to your own copy:
$ cp render/render_settings_example.js render/render_settings.jsto create your ownrender_settings.jssettings file. In this file modify everything to your own preferences. Follow the provided example to specify title mappings: A raw window title comes in, and we match it against regular expressions to determine what type of activity it is. For example, the code would convert "Google Chrome - some cool website" into just "Google Chrome". Follow the provided example and read the comments for all settings in the file. - Once that's set up, start the web server viewer:
$ python ulogme_serve.py, and go to to the provided address) for examplehttp://localhost:8123) in your browser. Hit the refresh button on top right every time you'd like to refresh the results based on most recently recorded activity - If your data isn't loading, try to explicitly run
python export_events.pyand then hit refresh. This should only be an issue the very first time you run ulogme.
The user interface can switch between a single day view and an overview view by link on top. You have to hit the refresh button every time you'd like to pull in new data.
- You can enter a reminder "blog" on top if you'd like to summarize the day for yourself or enter other memos.
- Click on any bar in the barcode view to enter a custom (short) note snippet for the time when the selected activity began. I use this to mark meetings, track my coffee/food intake, sleep time, or my total time spent running/swimming/gym or to leave notes for certain patterns of activity, etc. These could all later be correlated with various measures of productivity, in future.
- You can click the window titles to toggle them on and off from the visualization
- Clicking on the vertical bars takes you to the full statistics for that day.
- One Ubuntu user reported broken view with no data. On further inspection we found that the logs were corrupt. One of the lines in a file in
/logswas, instead of looking as{timestamp} {data}looked as@@@@@@@{timestamp} {data}, in other words an odd character was appended to the timestamp somehow. We manually erased these characters from the log file to fix the issue. - Legacy code note: if you used ulogme from before 28 July, you will have to run
$ python legacy_split_events.pyto convert your events files, once. - You may see "address already in use" if you try to run
python ulogme_serve.py. Sometimes the system can get confused and takes a while to update what ports are being used. Use the optional argument to specify a different port, for examplepython ulogme_serve.py 8124and then go tohttp://localhost:8124instead, for example. - Overview page is blank. Are you sure your browser supports ECMAScript 6? Chrome should be fine, Firefox might not be, yet.
The Ubuntu and OSX code base are a little separate on the data collection side. However, they each just record very simple log files in /logs. Once the log files are written, export_events.py takes the log files, does some simple processing and writes the results into .json files in /render. The Javascript/HTML/CSS UI codebase is all common and all lives in /render.
ulogme has three main parts:
- Recording scripts
keyfreq.shandlogactivewin.sh. You probably won't touch these. - Webserver:
ulogme_serve.pywhich wraps Python'sSimpleHTTPServerand does some basic communication with the UI. For example, the UI can ask the server to write a note to a log file, or for a refresh. - The UI. Majority of the codebase is here, reading the
.jsonfiles in/renderand creating the visualizations. There are several common.jsfiles, and crucially theindex.htmlandoverview.htmlfiles. I expect that most people might be able to contribute here to add features/cleanup/bugfix.
Things get a little ugly in OSX if you want to change anything with recording the log files because you have to recompile these portions any time you make any changes. It's ugly and it had to be done. However, if you're only interested in hacking with the UI, just change Javascript in render and no recompile is necessary, naturally.
- selfspy, Log everything you do on the computer, for statistics, future reference and all-around fun.
- arbtt, automatic rule-based time tracker.
For more projects, this question on Personal Productivity Stack Exchange might be also worth a look.
MIT
