"Not all source records have been copied." Pivot Table error

I get this error when double clicking on a pivot table. The normal behavior is for Excel to copy the cells feeding into the cell I clicked on from the undelrying sheet into a new worksheet. It seems to fail whenever the underlying data is too big. It works fine for the pivots based on a reasonable amount of data but in the case it’s failing, the underlying sheet has around 400 columns and 50,000 rows.

Does anyone know if this is the cause of the error and if so, what can be done about it? Thanks for the help folks.