They've filmed Joyce's Ulysses, more than once. I think to be truly unfilmable it would have to be a book that was all over the place in contents, theme, and characterization so that no coherent narrative could be found no matter how hard a person tried. Chuck Wendig's Star Wars Aftermath, for example, is a prime candidate for being unfilmable. Since it is also unreadable with a sane mind.
no subject