I am currently learning HtmlUnit in order to scrape websites. Everything went well and smooth until I encountered a dynamic page (as an example, I am using Pinterest website) on which elements are added on the fly when the user scrolls down.
I have tried several ways that should trigger the scrolling in a real browser (I will show them below). Before going further, I would like to mention that I have the following configuration already set:
Lets' say I want to get all my followers on Pinterest. I navigate until that page and now since the first time you only have 24 of them, I want to scroll down, event that triggers the Ajax call to the server and retrieves the next set of followers.
2) Change the focus from one follower anchor to the other (I chose the anchor because it is used in the focus order when you click on TAB key):
I tried many other methods but no positive result until now.
I read a lot of related articles, also here on stackoverflow, concerning that topic. And it seems that nobody managed to make scroll work using HtmlUnit since most of the questions remained unanswered. That is why I am wondering if that feature was ever functional.
Did someone manage to scroll a page (simple page, no ajax)? Did someone manage to scroll a page, event which trigger s some ajax call?