Forum Discussion

SamL's avatar
SamL
Icon for 512Official rank512Official
2 years ago
Solved

Comparing Data within 512Data

What's the most efficient way to compare two excel files and point out the differences?

data science
developer
  • josh's avatar
    josh
    2 years ago

    If the Excel files are part of a collaborative project or undergo frequent updates, consider using version control systems like Git. These systems can track changes over time and highlight differences between different versions of the files.

    Choose the approach that best fits your specific requirements, considering factors such as the size of the datasets, the complexity of the data, and your familiarity with different tools and techniques.

14 Replies

Sort By
  • CarlosJ's avatar
    CarlosJ
    Icon for 512Official rank512Official
    2 years ago

    I suggest you transpose both data sets then join them together and by doing so you will see all the similarities and differences from the join tool and when your happy you can cross tab the data back out again

  • EmmaP's avatar
    EmmaP
    Data Genius
    2 years ago

    The most efficient way to compare two Excel files and point out the differences is by utilizing specialized third-party software designed for Excel file comparison, such as Beyond Compare or Spreadsheet Compare, which streamline the process and offer advanced functionality.

    • Loki's avatar
      Loki
      2 years ago

      If your Excel files contain structured data, consider importing them into a database (e.g., SQL Server, MySQL) and using SQL queries to compare the data. This approach is more complex but can be highly efficient for large datasets.

      • SamL's avatar
        SamL
        Icon for 512Official rank512Official
        2 years ago

        Yes I think that approach is the most scalable!

  • SamL's avatar
    SamL
    Icon for 512Official rank512Official
    2 years ago

    Try this script!

    import os
# Function to rename multiple files
def main():
	i = 0
	path="E:/amit/"
	for filename in os.listdir(path):
		my_dest ="new" + str(i) + ".jpg"
		my_source =path + filename
		my_dest =path + my_dest
		# rename() function will
		# rename all the files
		os.rename(my_source, my_dest)
		i += 1
# Driver Code
if __name__ == '__main__':
	# Calling main() function
	main()
    • ArnaudL's avatar
      ArnaudL
      Icon for 512Official rank512Official
      2 years ago

      I've just tweaked it a bit. Don't thank me, you're welcome SamL ! 😉

      import os
# Function to rename multiple files
def main():
	i = 0
	path="E:/amit/"
	for filename in os.listdir(path):
		my_dest ="new" + str(i) + ".png"
		my_source =path + filename
		my_dest =path + my_dest
		# rename() function will
		# rename all the files
		os.rename(my_source, my_dest)
		i += 2
# Driver Code
if __name__ == '__main__':
	# Calling main() function
	main()

       

  • josh's avatar
    josh
    Data Curious
    2 years ago

    If the Excel files are part of a collaborative project or undergo frequent updates, consider using version control systems like Git. These systems can track changes over time and highlight differences between different versions of the files.

    Choose the approach that best fits your specific requirements, considering factors such as the size of the datasets, the complexity of the data, and your familiarity with different tools and techniques.

    • SamL's avatar
      SamL
      Icon for 512Official rank512Official
      6 months ago
      DaveEvGUEST wrote:

      "diff" function

      Love this function!

      512-Moderator wrote:

      Excellent choice!

      I agree completely!