Adding items from multiple sheets in pivot table (BOM)

I am trying to create a pivot table to manage multiple Bill of Materials (BOM). Each table has the same headers like item number, description and qty. The tables have different amount of rows. Some of the items in the different tables are the same, like the same bolt used in different sub assemblies. I managed to get multiple tables to be available in my pivot table by making them into tables first and then activating the "add to Data Model" option when selecting the first table to make the pivot table. I then created a relationship between the tables with the PartNo property. However, only the first table is showing up as a result in my table and the number of bolts across the tables does not add up.

Example, Table 1:

PartNo	Description	QTY
B01	Bolt	2
N02	Nut	2
BR01	Bracket 90deg	1

Example, Table 2:

PartNo	Description	QTY
B01	Bolt	2
N02	Nut	2
BR02	Bracket 45deg	1

Example, Result I would like:

PartNo	Description	QTY
B01	Bolt	4
N02	Nut	4
BR01	Bracket 90deg	1
BR02	Bracket 45deg	1

What I get instead is basically table 1.

What do I have to do to have it include all tables?