It's actually a bit of both. Because the crystal is effectively storing the character's emotions via the drops, it has the potential to hold memories tied to said emotions. But it can only be done by those who are skilled to do so, in this case high leveled dunamis users of that field, or an Arehtei.

So while it could be done, it would probably be a split opinion as to whether to do so or not. One side would think it to be an extreme invasion of privacy while the other would want to pursue for knowledge. It also would be difficult since one would have to filter through all memories and there wouldn't be an easy "fast forward" or "search" function.