Hierarchical compression techniques allow the storage of very large hollow linear systems by representing only the most significant data from an algebraic point of view. We are working on using such techniques to solve very large linear systems in a hybrid way (direct and iterative).