You may find that the file type is wrong.
Firstly, check the scan settings. How are you saving the scan?
If you save as a JPeg, the algorithm used can often create changes. You need to save in a lossless format and may have to forgo the compression ratio.
You may find saving in black and white will reduce the file size anyway, but most use Tiff format when saving scanned documents.