Most of the JPA implementations are using one or more caches to improve performance.
Wonseok Kim describs in his block the behavior of TopLink Essentials.
Reading this article gives you a good idea how caching could affect the behavior of your application.