Due to the recent surge of comment spam on Nicolas's blog (160+ in 10 days), I've now implemented the most basic captcha I could think of for posting comments in our blogs. FWIW, I used a text input, instead of the simpler alternatives: a checkbox or a dropdown so that it is unlikely to be bypassed "unintentionally" by random content.

I wonder how long it'll take to get some spam again. I hope it will take a while as I think that even this utterly basic system should keep the spam bots away until a spammer investigate this site in particular, and I guess this shouldn't happen anytime soon (given that we only host our own blogs).

Lately, I added some new features to relatorio.

• The use of ConTeXt to generate pdf files, it thus remove the dependancy on the trml2pdf that has not seen a release in age. It also shows how you can use a shell command to generate documents.
• Support for the opendocument spreadsheet and presentation files, the help of Udo Spallek has been precious for this. So with relatorio, you can now generate a dump of your data, and use it to construct pivot table (us geek do not now what it is but believe me it is a key knowledge for every big business consultant), and presentations.

The openoffice change involve a change in the way you add your variables to the template. In previous version we were using <text:placeholder> tags, but it was not possible to add them through OO UI (and that they get replaced if you add them by hand) in Calc. We choose to replace it by <text:a> tags, the URL must start with relatorio:// and be followed by your directive or expression. As some has noted this might create subtle bugs thus I included warnings if the href attribute differs from content of the tag. But I think that if you are using the genshi interpolation feature there should be only structural information in the A tags.

Another nice addition to the openoffice templating mechanism, is that now we support inner documents. Thus if you include an opendocument spreadsheet in a text document, the data inside the spreadsheet will be interpreted as well.

UPDATE: finally, relatorio now supports both the old <text:placeholder> syntax and the new one.

Lately I got a lot of help from Cédric of b2ck (another bunch of ex-tiny employees) so that they can replace the openerp way to do things (they are using the deprecated .sxw format) by relatorio openoffice reports.

In order to meet their needs, I complety reviewed the way the openoffice template is written. We work now much more similarly to other genshi templates and it brings some nice goodies :

• generate outputs a genshi Stream that can be rendered as an OpenOffice document,
• testing is way more easy,
• you can apply filters to this stream in order to translate the document,
• styles.xml is now templateable, that way you can make use of openoffice template documents

Cédric also pointed me to bugs in my setup.py and in the way I handled the namespaces from the OO documents. Opening relatorio development really brought us a lot of good ideas and feedback. I am really glad we did this and we will keep doing it at a faster pace then previously planned.

I took some time today and yesterday to switch the relatorio repository to mercurial. The hardest thing in the migration was the Trac plugin that had a SyntaxError and some mess with easy_install.

Next on my schedule: migrating our framework and our client to mercurial. I expect this to be somewhat more difficult since they share the same subversion repository and I'd like to split them in two different hg repository.

Today, I'm very proud to announce the birth of our new project : relatorio, a reporting module able to generate a whole lot of different document types from templates. relatorio is a Portuguese word that means report, I choose Portuguese because the Spanish/French words did not sound good enough.

Technically, we are using genshi and trml2pdf (the homepage does not work anymore) to create PDF and OpenOffice documents.

In this post I'll show you how easy it is to create OpenOffice documents using relatorio. First we need some objects to work on. Let's create a fake invoice object:

class Invoice(dict):
    @property
    def total(self):
        return reduce(operator.add, (l['amount'] for l in self['lines']), 0)
    @property
    def vat(self):
        return self.total * 0.21
inv = Invoice(customer={'name': 'John Bonham',
                        'address': {'street': 'Smirnov street',
                                    'zip': 1000,
                                    'city': 'Montreux'}},
              lines=[{'item': {'name': 'Vodka 70cl',
                               'reference': 'VDKA-001',
                               'price': 10.34},
                      'quantity': 7,
                      'amount': 7*10.34},
                     {'item': {'name': 'Cognac 70cl',
                               'reference': 'CGNC-067',
                               'price': 13.46},
                      'quantity': 12,
                      'amount': 12*13.46},
                     {'item': {'name': 'Sparkling water 25cl',
                               'reference': 'WATR-007',
                               'price': 0.4},
                      'quantity': 1,
                      'amount': 0.4},
                     {'item': {'name': 'Good customer rebate',
                               'reference': 'BONM-001',
                               'price': -20},
                      'quantity': 1,
                      'amount': -20},
                    ],
              id='MZY-20080703',
              status='late')

So we created an invoice for the famous Led Zeppelin's drummer and his favorite addiction.

The next thing to do is to create a template for invoices. We will use the one displayed below. To create the genshi directives, you just need to create a text-type placeholder [1] field, and fill it with the expression you want to use.

You can now start to use relatorio to create John Bonham's invoice.

from relatorio.templates.odt import Template
basic = Template(source=None, filepath='basic.odt')
file('bonham_basic.odt', 'w').write(basic.generate(o=inv).getvalue())

On the first line we import the odt Template engine. This class has the same signature as the one from genshi but uses only the filepath arguments. It returns a StringIO object that can be used to write the report on the disc.

And so here is our invoice with all the fields completed according to the Invoice object we created earlier. Notice how the style we set in the template are also applied in the resulting invoice.

We made use of the py:for directive. But it is not the only genshi directive supported by the relatorio odt plugin, it also support py:if, py:choose/py:when/py:otherwise and py:with.

We also included a simple report repository that allows you to link your reports to a class and retrieve them by the name you gave them or by the mimetype they output.

>>> import relatorio
>>> repos = relatorio.ReportRepository()
>>> repos.add_report(Invoice, 'application/vnd.oasis.opendocument.text',
...                  'basic.odt', report_name='basic')
>>> repos.add_report(Invoice, 'application/vnd.oasis.opendocument.text',
...                  'invoice.odt', report_name='complicated')
>>> repos.reports[Invoice]['basic']
('application/vnd.oasis.opendocument.text',
 <relatorio report on /home/nicoe/tmp/relatorio_demo/basic.odt>)
>>> repos.reports[Invoice]['application/vnd.oasis.opendocument.text']
[('basic',
  <relatorio report on /home/nicoe/tmp/relatorio_demo/basic.odt>),
 ('complicated',
  <relatorio report on /home/nicoe/tmp/relatorio_demo/invoice.odt>)]

Moreover, the report repository works with a TemplateLoader object that automatically reloads a template when the file used to create it has been modified.

When using the report repository, you're also working with the relatorio reports, those are proxies over a Template that enables you to pre-process data before rendering it. The default behavior is to bind your object to the template variable o and all other arguments to the variable args. Here is an example showing you how you could use it in cherrypy to make the request object available to all your reports.

class OHFactory(relatorio.DefaultFactory):
   def __call__(self, obj, **kwargs):
       data = {}
       data['o'] = obj
       data['args'] = kwargs
       data['request'] = cherrypy.request
       return data

I hope you will find this module usefull and abuse it in every way.