Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rake task for dumping, restoring and anonymizing user data #1013

Open
wants to merge 7 commits into
base: master
Choose a base branch
from
+63 −0
Open

rake task for dumping, restoring and anonymizing user data #1013

Changes from 2 commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
5449b8f
rake task for dumping, restoring and anonymizing user data
dkuku Jan 5, 2019
e6ca634
corrected CI offenses
dkuku Jan 5, 2019
47a1481
Update backend/lib/tasks/db.rake
roschaefer Jan 9, 2019
baa8e0c
Update backend/lib/tasks/db.rake
roschaefer Jan 9, 2019
d7a700b
Anonymize Broadcast.creator_id
dkuku Jan 10, 2019
0d68f00
Remove unused code
dkuku Jan 10, 2019
5543e89
Merge upstream
dkuku Jan 10, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
54 changes: 54 additions & 0 deletions backend/lib/tasks/db.rake
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,54 @@
namespace :db do
desc 'replace user sensitive data with placeholders'
task anonymize_user: :environment do
if ENV['RAILS_ENV'] == 'production'
puts 'You do not want to anonymize production data'
else
puts 'Anonymizing user data'

User.all.each do |user|
dkuku marked this conversation as resolved.
Show resolved Hide resolved
user.encrypted_password = user.encrypted_password.truncate(8)
user.latitude = 50 + 0.001 * user.id
user.longitude = 10 - 0.001 * user.id
user.city = "city#{user.id}"

user.email = "user#{user.id}@rundfunk.com"
dkuku marked this conversation as resolved.
Show resolved Hide resolved
user.save!
end
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dkuku you can probably update all the users in one sql statement: https://apidock.com/rails/ActiveRecord/Base/update_all/class

User.update_all(:password, 'xxxxxx')
User.update_all(:latitute, '50 + 0.001 * users.id')
# ... etc

end
end

desc 'Dumps the database to db/APP_NAME.dump'
task dump: :environment do
app, host, db, user = with_config
cmd = "pg_dump --host #{host} #{user_present?(user)} --verbose --clean --no-owner --no-acl --format=c #{db} > #{Rails.root}/db/#{app}.dump"
puts cmd
exec cmd
end

desc 'Restores the database dump at db/APP_NAME.dump.'
task restore: :environment do
app, host, db, user = with_config
cmd = "pg_restore --verbose --host #{host} #{user_present?(user)} --clean --no-owner --no-acl --dbname #{db} #{Rails.root}/db/#{app}.dump"
Rake::Task['db:drop'].invoke
Rake::Task['db:create'].invoke
Rake::Task['db:migrate'].invoke
puts cmd
exec cmd
end

private

def user_present?(user)
user ? '--username ' + user : nil
end

def with_config
[
Rails.application.class.parent_name.underscore,
ActiveRecord::Base.connection_config[:host],
ActiveRecord::Base.connection_config[:database],
ActiveRecord::Base.connection_config[:username]
]
end
end