54 Commits

Author SHA1 Message Date
laurenspriem
b1ce7b6edb [mob][photos] Fix empty facethumbnail due to decoding issue 2025-02-13 11:16:32 +05:30
laurenspriem
3a8ec51674 [mob][photos] Revert onnx preprocessing 2024-10-23 17:05:13 +05:30
Laurens Priem
b9dd0bc3b7
ONNX changes (#3654)
## Description

- Quantized the CLIP text encoder
- Moved preprocessing and postprocessing of face detection inside the
model
- Optimised the ONNX models more wherever possible
- Created a place in infra for ML version control of sorts

## Tests

Have tested the changes on mobile, but not on desktop. Please carefully
review the changes on desktop, especially regarding the face detection
post-processing, more specifically the image (re-)size correction.
2024-10-11 10:02:11 +05:30
laurenspriem
1cdc7aa594 [mob][photos] Decode heic using flutter compress 2024-10-10 18:45:05 +05:30
laurenspriem
fa19254bbc [mob][photos remove old clip preprocessing code 2024-09-25 23:04:29 +05:30
laurenspriem
762fa7150e [mob][photos] Refactor 2024-09-08 19:28:06 +02:00
laurenspriem
db6f8dbff8 [mob][photos] comment 2024-09-08 14:26:45 +02:00
laurenspriem
af25c83aa2 [mob][photos] Use antialias for 80% scale and lower 2024-09-08 14:19:58 +02:00
laurenspriem
23eaab0757 [mob][photos] Fix regression I created 2024-09-06 17:27:42 +02:00
laurenspriem
e9d6f46997 [mob][photos] Use antialias with clip image 2024-09-06 14:16:27 +02:00
laurenspriem
9b743d7afe [mob][photos] Stop using ByteData directly 2024-09-06 13:51:01 +02:00
laurenspriem
c94db7e9b8 [mob][photos] Remove unused method 2024-09-06 13:10:56 +02:00
laurenspriem
13f1309857 [mob][photos] Logging 2024-09-03 13:36:48 +02:00
laurenspriem
ed3b27475e [mob][photos] Try converting any unsupported format on Android 2024-09-03 13:13:56 +02:00
laurenspriem
9dadb92d8d [mob][photos] Last logging todos 2024-09-03 12:49:45 +02:00
laurenspriem
ab636232ff [mob][photos] Cleaner logging 2024-09-03 12:04:35 +02:00
laurenspriem
a9bc6502cb [mob][photos] proper logging in ML indexing isolate 2024-08-30 13:58:46 +02:00
laurenspriem
91646a809b [mob][photos] Actual logging in ML Computer 2024-08-30 12:07:06 +02:00
laurenspriem
0121643558 [mob][photos] Log format of decoding error 2024-08-26 16:53:01 +02:00
laurenspriem
a328189891 [mob][photos] Use bilinear interpolation for clip 2024-08-23 10:35:26 +02:00
laurenspriem
87a17c0034 [mob][photos] Convert heic to jpg for ML on Android 2024-08-21 18:20:49 +02:00
laurenspriem
f4a46a1fd3 [mob][photos] Refactor MLResults processing 2024-08-21 13:33:20 +02:00
Neeraj Gupta
810cf6f885 [mob] Use single db for ml data 2024-08-14 14:21:52 +05:30
Neeraj Gupta
bd53c4a2f3 Switch to mobileclip 2024-08-12 20:43:16 +05:30
laurenspriem
64a2544e95 [mob][photos] Face detection cleanup 2024-07-03 22:33:38 +05:30
laurenspriem
393ed91e86 [mob][photos] Use centercrop instead of empty pixels 2024-06-28 18:27:52 +05:30
laurenspriem
d7e1b737d8 [mob][photos] Use existing image utils for clip preprocessing 2024-06-28 18:20:35 +05:30
laurenspriem
897245d6c1 [mob][photos] Cleanup alignment 2024-06-22 18:23:53 +05:30
laurenspriem
7c535adff1 [mob][photos] Make blur detection static method 2024-06-22 00:36:07 +05:30
laurenspriem
e2da01dd5b [mob][photos] Simplify SimilarityTransform 2024-06-19 18:06:24 +05:30
laurenspriem
848f3a0f6b [mob][photos] Cleanup image utils 2024-06-18 18:17:40 +05:30
laurenspriem
1b46e159da [mob][photos] Put x and y instead of xMin and yMin in embeddingsJSON 2024-05-21 14:03:19 +05:30
laurenspriem
10b04c6ad3 [mob][photos] Make sure face in face thumbnail is always centered 2024-04-30 16:31:36 +05:30
laurenspriem
4cff6b1299 [mob][photos] Simplify face generation code 2024-04-30 15:44:32 +05:30
laurenspriem
740ca907f2 [mob][photos] Prevent face cropping out of image bounds 2024-04-30 11:38:39 +05:30
laurenspriem
9f5c5fde49 [mob][photos] Parallelize the cropping and encoding of faces 2024-04-30 10:59:45 +05:30
laurenspriem
8b1545239c [mob][photos] Use canvas again for generating face thumbnail 2024-04-29 16:28:19 +05:30
laurenspriem
e3b8d8975f [mob] Better blur detection handling background noise 2024-04-16 14:51:23 +05:30
Neeraj Gupta
107b79eae6 [mob] Reduce invalid pixel noise 2024-04-12 16:19:51 +05:30
laurenspriem
4cb15268e9 [mob] Cleaner handling of decoded image dimensions 2024-04-08 15:24:14 +05:30
laurenspriem
a4582c0e55 Move FaceML inside Machine Learning directory 2024-03-20 15:51:57 +05:30
laurenspriem
39f16ff517 Only show high quality faces in file info 2024-03-20 14:34:12 +05:30
laurenspriem
58c85c8c13 Deprecating some methods 2024-03-15 18:22:40 +05:30
laurenspriem
0b0a0cec26 [mob] Only run decoding of images once 2024-03-15 18:15:57 +05:30
laurenspriem
9285baace2 Change Face to use relative coordinates 2024-03-15 17:07:17 +05:30
laurenspriem
05f188080b Remove image package in thumbnail generation 2024-03-15 14:53:40 +05:30
laurenspriem
847a99d0e9 Fix cutoff face thumbnails 2024-03-15 12:52:27 +05:30
laurenspriem
52b787f71e Face thumbnail generation without canvas 2024-03-15 12:48:01 +05:30
laurenspriem
74d1cbb01f Use full file on face detection 2024-03-14 16:13:27 +05:30
laurenspriem
83b9afa5c8 custom interpolation for face detection 2024-03-13 16:36:45 +05:30