You can load first the rows for the first few pages, so the datagrid is displayed quickly. Then get a timer to load the rest after half a second. The rest of the rows will be available before the user has time to click on the pager.
Here is the description of the timer approach, on the “Delay loading the bulk of the data” paragraph: [Wiki] Performance optimization