We experimentally study the effect of Joule heating on the electron temperature in metallic nanoscale devices and compare the results with a diffusive 3D finite element model. The temperature is probed using four thermocouples located at different distances from the heater. A good quantitative agreement, within 30%, between the experimental data and the modeling is obtained. Since we observe a strong thickness dependence of the electrical conductivity of our metals, we find that the Joule heating in nanoscale devices is often incorrectly calculated if bulk conductivities are used.