Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion app/services/db/doc_auth_log/drop_off_rates_helper.rb
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ def select_counts_from_doc_auth_logs
count(COALESCE(back_image_view_at,mobile_back_image_view_at,capture_mobile_back_image_view_at,present_cac_view_at)) as back_image,
count(COALESCE(ssn_view_at,enter_info_view_at)) as ssn,
count(verify_view_at) as verify_info,
count(COALESCE(doc_success_view_at,success_view_at)) as doc_success,
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we know if any of our reporting consumers rely on this column? Or rely on a specified # of columns?

If so, should we put a 0, -1 or "N/A" there?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we know if any of our reporting consumers rely on this column? Or rely on a specified # of columns?

If so, should we put a 0, -1 or "N/A" there?

I'm not totally familiar with how these are used, so I'd defer to others for specifically how they're used. I wasn't able to find many resources on how these reports are used. Do you know if any exist?

Though, as I look at it again, this may need to stay regardless, because success_view_at corresponds to the CAC flow success step, which is not intended to be removed with these changes†.

So it might instead need to stay as...

Suggested change
count(COALESCE(doc_success_view_at,success_view_at)) as doc_success,
count(success_view_at) as doc_success,

† It seems to serve a very similar purpose to the doc auth success step though, so if we're removing one, we should probably remove the other as well. Not something I'd expect to be covered by the current incarnation of the ticket.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Restored this for success_view_at in 0857bcc, so we're only disregarding the now-removed doc_success_view_at column.

Could still do for a second set of eyes (@stevegsa or yourself) to confirm though.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unfortunately, I don't have a good sense of how these are used, Chris and Silke had workflows for these but they've left the project so I don't know who looks at them now 😬

Copy link
Copy Markdown
Contributor

@stevegsa stevegsa Nov 2, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The metrics will still work for the other steps after doc_success so it's ok to take it out in both instances (cac and doc_auth). I don't think there are any queries where we specifically check doc_success other than just reporting that step in the funnel. After this change we can just remove that step in the funnel. Then the people that make it to phone screen should still be the same but it would necessarily imply that they succeeded the verify step.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @stevegsa . If I read correctly, it sounds like we'll want to (or are at least covered in reporting) to remove both the DocSuccessStep and Cac::Success steps. Since this ticket only accounted for the first of these, I'll plan to keep everything as-is for the CAC success step, and open a ticket to explore its removal in the future (UX feedback, etc).

Let me know if I've misunderstood or if there are any concerns to do this separately.

count(success_view_at) as doc_success,
count(verify_phone_view_at) as phone,
count(encrypt_view_at) as encrypt,
count(verified_view_at) as personal_key
Expand Down
1 change: 0 additions & 1 deletion app/services/funnel/doc_auth/register_step.rb
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,6 @@ class RegisterStep
verify_phone
encrypt
verified
doc_success
usps_address
usps_letter_sent
capture_mobile_back_image
Expand Down
1 change: 0 additions & 1 deletion app/services/idv/flows/doc_auth_flow.rb
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,6 @@ class DocAuthFlow < Flow::BaseFlow
ssn: Idv::Steps::SsnStep,
verify: Idv::Steps::VerifyStep,
verify_wait: Idv::Steps::VerifyWaitStep,
doc_success: Idv::Steps::DocSuccessStep,
}.freeze
OPTIONAL_SHOW_STEPS = {
verify_wait: Idv::Steps::VerifyWaitStepShow,
Expand Down
1 change: 0 additions & 1 deletion app/services/idv/flows/recovery_flow.rb
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,6 @@ class RecoveryFlow < Flow::BaseFlow
ssn: Idv::Steps::SsnStep,
verify: Idv::Steps::RecoverVerifyStep,
verify_wait: Idv::Steps::RecoverVerifyWaitStep,
doc_success: Idv::Steps::DocSuccessStep,
}.freeze

OPTIONAL_SHOW_STEPS = {
Expand Down
25 changes: 0 additions & 25 deletions app/services/idv/steps/doc_success_step.rb

This file was deleted.

1 change: 1 addition & 0 deletions app/services/idv/steps/verify_wait_step_show.rb
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,7 @@ def async_state_done(current_async_state)
delete_async

if response.success?
flash[:success] = I18n.t('doc_auth.forms.doc_success')
mark_step_complete(:verify_wait)
else
mark_step_incomplete(:verify)
Expand Down
25 changes: 0 additions & 25 deletions app/views/idv/doc_auth/doc_success.html.erb

This file was deleted.

2 changes: 1 addition & 1 deletion config/locales/doc_auth/en.yml
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ en:
choose_file_html: Drag file here or <lg-underline>choose from folder</lg-underline>
city: City
dob: Date of Birth
doc_success: We've verified your social security number and state-issued ID.
doc_success: We have verified your personal information
first_name: First Name
last_name: Last Name
selected_file: Selected file
Expand Down
3 changes: 1 addition & 2 deletions config/locales/doc_auth/es.yml
Original file line number Diff line number Diff line change
Expand Up @@ -70,8 +70,7 @@ es:
choose_file_html: Arrastre el archivo aquí o <lg-underline>elija de la carpeta</lg-underline>
city: Ciudad
dob: Fecha de nacimiento
doc_success: Verificamos su número de seguro social y su identificación emitida
por el estado.
doc_success: Hemos verificado su información personal
first_name: Nombre de pila
last_name: Apellido
selected_file: Archivo seleccionado
Expand Down
3 changes: 1 addition & 2 deletions config/locales/doc_auth/fr.yml
Original file line number Diff line number Diff line change
Expand Up @@ -76,8 +76,7 @@ fr:
un dossier</lg-underline>
city: Ville
dob: Date de naissance
doc_success: Nous avons vérifié votre numéro de sécurité sociale et votre identifiant
délivré par l'État.
doc_success: Nous avons vérifié vos informations personnelles
first_name: Prénom
last_name: Nom de famille
selected_file: Fichier sélectionné
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
class DropDocSuccessViewFromDocAuthLogs < ActiveRecord::Migration[5.2]
def up
safety_assured do
remove_column :doc_auth_logs, :doc_success_view_at
remove_column :doc_auth_logs, :doc_success_view_count
end
end

def down
add_column :doc_auth_logs, :doc_success_view_at, :datetime
add_column :doc_auth_logs, :doc_success_view_count, :integer, default: 0
end
end
4 changes: 1 addition & 3 deletions db/schema.rb
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@
#
# It's strongly recommended that you check this file into your version control system.

ActiveRecord::Schema.define(version: 2020_10_29_192324) do
ActiveRecord::Schema.define(version: 2020_11_02_150543) do

# These are extensions that must be enabled in order to support this database
enable_extension "plpgsql"
Expand Down Expand Up @@ -138,8 +138,6 @@
t.integer "verify_view_count", default: 0
t.integer "verify_submit_count", default: 0
t.integer "verify_error_count", default: 0
t.datetime "doc_success_view_at"
t.integer "doc_success_view_count", default: 0
t.datetime "verify_phone_view_at"
t.integer "verify_phone_view_count", default: 0
t.datetime "usps_address_view_at"
Expand Down
6 changes: 3 additions & 3 deletions spec/features/idv/doc_auth/cancel_spec.rb
Original file line number Diff line number Diff line change
Expand Up @@ -6,11 +6,11 @@

before do
sign_in_and_2fa_user
complete_doc_auth_steps_before_doc_success_step
complete_doc_auth_steps_before_verify_step
end

it 'correctly restarts doc auth flow upon cancel and revisit' do
expect(page).to have_current_path(idv_doc_auth_success_step)
expect(page).to have_current_path(idv_doc_auth_verify_step)

click_link t('links.cancel')

Expand All @@ -24,7 +24,7 @@
visit account_path
expect(current_path).to eq(account_path)

visit(idv_doc_auth_success_step)
visit(idv_doc_auth_verify_step)
expect(current_path).to eq(idv_doc_auth_welcome_step)
end
end
22 changes: 0 additions & 22 deletions spec/features/idv/doc_auth/doc_success_step_spec.rb

This file was deleted.

2 changes: 1 addition & 1 deletion spec/features/idv/doc_auth/finished_spec.rb
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@

it 'is on the correct page when using the back button after final step' do
expect(page).to have_current_path(idv_phone_path)
visit '/verify/doc_auth/doc_success'
visit '/verify/doc_auth/verify'
expect(page).to have_current_path(idv_phone_path)
end
end
5 changes: 3 additions & 2 deletions spec/features/idv/doc_auth/verify_step_spec.rb
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,8 @@
it 'proceeds to the next page upon confirmation' do
click_idv_continue

expect(page).to have_current_path(idv_doc_auth_success_step)
expect(page).to have_current_path(idv_phone_path)
expect(page).to have_content(t('doc_auth.forms.doc_success'))
user = User.first
expect(user.proofing_component.resolution_check).to eq('lexis_nexis')
expect(user.proofing_component.source_check).to eq('aamva')
Expand Down Expand Up @@ -111,7 +112,7 @@
complete_doc_auth_steps_before_verify_step
click_idv_continue

expect(page).to have_current_path(idv_doc_auth_success_step)
expect(page).to have_current_path(idv_phone_path)
end
end

Expand Down
3 changes: 2 additions & 1 deletion spec/features/idv/recovery/recover_fail_step_spec.rb
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,8 @@
sign_in_before_2fa(user)
allow_any_instance_of(Idv::Steps::RecoverVerifyWaitStepShow).to receive(:saved_pii).
and_return(bad_pii.to_json)
complete_recovery_steps_before_doc_success_step
complete_recovery_steps_before_verify_step
click_idv_continue
end

it 'fails to re-verify if the pii does not match and then it proceeds to start re-verify over' do
Expand Down
20 changes: 9 additions & 11 deletions spec/features/reports/doc_auth_funnel_report_spec.rb
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
'total_verify_attempted_users_count' => 2,
}
end
let(:doc_success_funnel) do
let(:verify_funnel) do
{
'back_image_error_count_average' => 0.0,
'back_image_submit_count_average' => 1.0,
Expand All @@ -34,8 +34,6 @@
'capture_mobile_back_image_submit_count_average' => 0.0,
'choose_method_view_count_average' => 0.0,
'choose_method_view_percent' => 0.0,
'doc_success_view_count_average' => 1.0,
'doc_success_view_percent' => 100.0,
'email_sent_view_count_average' => 0.0,
'email_sent_view_percent' => 0.0,
'encrypt_view_count_average' => 0.0,
Expand Down Expand Up @@ -79,8 +77,8 @@
'verified_view_count_average' => 0.0,
'verified_view_percent' => 0.0,
'verify_error_count_average' => 0.0,
'verify_phone_view_count_average' => 0.0,
'verify_phone_view_percent' => 0.0,
'verify_phone_view_count_average' => 1.0,
'verify_phone_view_percent' => 100.0,
'verify_submit_count_average' => 1.0,
'verify_view_count_average' => 1.0,
'verify_view_percent' => 100.0,
Expand All @@ -95,21 +93,21 @@

it 'works for one flow' do
sign_in_and_2fa_user(user)
complete_doc_auth_steps_before_doc_success_step
complete_all_doc_auth_steps

expect(subject.new.call).to eq(doc_success_funnel.merge(summary1))
expect(subject.new.call).to eq(verify_funnel.merge(summary1))

Funnel::DocAuth::ResetSteps.call(user.id)
expect(subject.new.call).to_not eq(doc_success_funnel.merge(summary1))
expect(subject.new.call).to_not eq(verify_funnel.merge(summary1))
end

it 'works for two flows' do
sign_in_and_2fa_user(user)
complete_doc_auth_steps_before_doc_success_step
complete_all_doc_auth_steps
sign_in_and_2fa_user(user2)
complete_doc_auth_steps_before_doc_success_step
complete_all_doc_auth_steps

expect(subject.new.call).to eq(doc_success_funnel.merge(summary2))
expect(subject.new.call).to eq(verify_funnel.merge(summary2))
end

it 'does not create a doc_auth_log entry without a welcome first' do
Expand Down
12 changes: 6 additions & 6 deletions spec/features/reports/proofing_costs_report_spec.rb
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@
'total_proofing_costs_users_count' => 2,
}
end
let(:doc_success_funnel) do
let(:verify_funnel) do
{
'acuant_front_image_count_average' => 1.0,
'acuant_back_image_count_average' => 1.0,
Expand All @@ -37,17 +37,17 @@

it 'works for one flow' do
sign_in_and_2fa_user(user)
complete_doc_auth_steps_before_doc_success_step
complete_all_doc_auth_steps

expect(report).to eq(doc_success_funnel.merge(summary1))
expect(report).to eq(verify_funnel.merge(summary1))
end

it 'works for two flows' do
sign_in_and_2fa_user(user)
complete_doc_auth_steps_before_doc_success_step
complete_all_doc_auth_steps
sign_in_and_2fa_user(user2)
complete_doc_auth_steps_before_doc_success_step
complete_all_doc_auth_steps

expect(report).to eq(doc_success_funnel.merge(summary2))
expect(report).to eq(verify_funnel.merge(summary2))
end
end
14 changes: 2 additions & 12 deletions spec/support/features/doc_auth_helper.rb
Original file line number Diff line number Diff line change
Expand Up @@ -62,10 +62,6 @@ def idv_doc_auth_mobile_back_image_step
idv_doc_auth_step_path(step: :mobile_back_image)
end

def idv_doc_auth_success_step
idv_doc_auth_step_path(step: :doc_success)
end

def idv_doc_auth_verify_step
idv_doc_auth_step_path(step: :verify)
end
Expand Down Expand Up @@ -164,14 +160,8 @@ def complete_doc_auth_steps_before_address_step(expect_accessible: false)
click_link t('doc_auth.buttons.change_address')
end

def complete_doc_auth_steps_before_doc_success_step(expect_accessible: false)
complete_doc_auth_steps_before_verify_step(expect_accessible: expect_accessible)
expect(page).to be_accessible.according_to :section508, :"best-practice" if expect_accessible
click_idv_continue
end

def complete_doc_auth_steps_before_self_image_step
complete_doc_auth_steps_before_doc_success_step
complete_doc_auth_steps_before_verify_step
click_idv_continue
end

Expand All @@ -187,7 +177,7 @@ def complete_doc_auth_steps_before_link_sent_step
end

def complete_all_doc_auth_steps(expect_accessible: false)
complete_doc_auth_steps_before_doc_success_step(expect_accessible: expect_accessible)
complete_doc_auth_steps_before_verify_step(expect_accessible: expect_accessible)
expect(page).to be_accessible.according_to :section508, :"best-practice" if expect_accessible
click_idv_continue
end
Expand Down
9 changes: 0 additions & 9 deletions spec/support/features/recovery_helper.rb
Original file line number Diff line number Diff line change
Expand Up @@ -39,11 +39,6 @@ def complete_recovery_steps_before_verify_step(user = user_with_2fa)
click_idv_continue
end

def complete_recovery_steps_before_doc_success_step(user = user_with_2fa)
complete_recovery_steps_before_verify_step(user)
click_idv_continue
end

def idv_recovery_recover_step(token)
idv_recovery_step_path(step: :recover, token: token)
end
Expand Down Expand Up @@ -75,8 +70,4 @@ def idv_recovery_verify_step
def idv_recovery_verify_wait_step
idv_recovery_step_path(step: :verify_wait)
end

def idv_recovery_success_step
idv_recovery_step_path(step: :doc_success)
end
end
3 changes: 0 additions & 3 deletions spec/support/monitor/monitor_idv_steps.rb
Original file line number Diff line number Diff line change
Expand Up @@ -41,9 +41,6 @@ def verify_identity_with_doc_auth
click_on 'Continue'
expect(page).to have_current_path('/verify/doc_auth/verify')

click_on 'Continue'
expect(page).to have_current_path('/verify/doc_auth/doc_success')
Comment on lines -44 to -45
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just ran into a smoke test flake and I'm very glad we're updating this here :]

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just ran into a smoke test flake and I'm very glad we're updating this here :]

I don't know that I'd have a ton of confidence that this won't just flake on the next screen, but at least one fewer assertion that can go awry. 😄


click_on 'Continue'
expect(page).to have_current_path('/verify/phone')

Expand Down