this post was submitted on 14 Feb 2025
46 points (97.9% liked)

Asklemmy

45236 readers
1742 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy ๐Ÿ”

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_[email protected]~

founded 5 years ago
MODERATORS
 

(bonus points if it's being used for official business purposes)

you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 7 points 1 week ago* (last edited 1 week ago)

An oil company which had an MS access DB and a form configured for it with no checks for formatting that would insert the fields of the form directly into the database, and then if they wanted to make a change, they would export the entire database as csv, open it in excel, make changes and use that to overwrite the entire database.

This had been going on since some time in the 1990's. They finally wanted to move to a modernized databasing/operations solution which is what my company does.

I successfully cleaned 75% of that data, however it took 37 regular expressions and a script that was about 800 lines to account for every possible mis-entry, incorrect format, and merging fields if they were empty from newest records to oldest records until the fields were no longer empty where possible (essentially collapsing the records together to get as much data on each unique object which may have had N records over time through the database).

It is UN-BELIEVABLE what actual businesses get away with.