X Server memory usage.

I would really like to know what’s causing my X server to have 350+MB private writable memory allocated after a few days of uptime.

pmap say what

Does anybody have any ideas or suggestions for investigation?