Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🔥 Remove unnecessary text slice #98

Merged
merged 1 commit into from
Jun 25, 2024

Conversation

evaline-ju
Copy link
Collaborator

@evaline-ju evaline-ju commented Jun 25, 2024

Unnecessary since in #76, text is already returned through the detectors API. We do not have to re-index to re-calculate the text

Related to: #96

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>
Copy link
Collaborator

@gkumbhat gkumbhat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me!

@gkumbhat
Copy link
Collaborator

We can keep the sliced_codepoints function around for later. Might become handy in some aggregation processing

@evaline-ju
Copy link
Collaborator Author

We can keep the sliced_codepoints function around for later. Might become handy in some aggregation processing

Yes it's also still used in masks processing

@evaline-ju evaline-ju merged commit e2668b1 into foundation-model-stack:main Jun 25, 2024
1 check passed
@evaline-ju evaline-ju deleted the offset-bug branch June 25, 2024 19:16
pmcjr pushed a commit to pmcjr/fms-guardrails-orchestrator that referenced this pull request Jul 1, 2024
Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Detected PII word's "start" and "end" are returning the wrong positions
2 participants