Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text...
Transcript of Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text...
![Page 1: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/1.jpg)
Deep Learning for Semantic Search in E-commerce
Somnath Banerjee
Head of Search Algorithms at Walmart Labshttps://www.linkedin.com/in/somnath-banerjee/
March 19, 2019
![Page 2: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/2.jpg)
Walmart E-commerce search problem
2
100M+Customers
100M+Queries
100M+Items
Store Associate E-commerce Search provides the functionality of a human but at scale
![Page 3: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/3.jpg)
3
????
Flash DriveUSB DriveThumb DriveJump DrivePen DriveZip DriveMemory StickUSB StickUSB Flash DriveUSB MemoryUSB Storage Device
Flush DriveUSC DriveThamb DriveJmp DrivePin DriveZap DriveMemory SteakUSB StockUSB Flash Drve
Misspelled Queries
![Page 4: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/4.jpg)
4
saddle
Horse Saddle
Bike Saddle
![Page 5: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/5.jpg)
Outline
5
• Core problems of e-commerce search
• Semantic search in e-commerce
• Deep Learning for semantic search– Query classification– Query token tagging– Neural IR– Image understanding (sneak peek)
![Page 6: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/6.jpg)
Core of E-commerce Search
6
Text Query
Text Query
Find Items
Catalog
![Page 7: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/7.jpg)
Core problems of E-commerce search
7
Learning book
Tide 100 ozTide 100 fl ozTide 100 ounce
Neck style?Fabric?No. of pockets?
Ziploc
Ambiguity
Missing catalog values
Levi’sLevi StraussSignature by Levi Strauss and Co.
Open vocabulary in query and catalog
![Page 8: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/8.jpg)
Buying decision is influenced by item attractiveness
8
pump shoes
Tags
$300!!!Presence of expensive items
Image quality
![Page 9: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/9.jpg)
Matching
query to items
Ranking
items
Core technical problems of e-commerce search
9
Pump shoes
✅
✅
❌
Position 1
Position 2
![Page 10: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/10.jpg)
Text matching is not enough
10
Lemon
Lemon BalmLemon Fruit
Nivea 16oz
Nivea 15.5ozTire sealant
16oz
![Page 11: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/11.jpg)
Query understanding
• Attribute understanding
Matching query and item
• Text matching
• Attribute matching
Ranking Items
Sematic Search
11
![Page 12: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/12.jpg)
Deep learning for semantic search
12
Deep Learning for Query understanding
Matching query and item
• Text matching
• Attribute matching
Ranking Items
![Page 13: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/13.jpg)
Deep learning for semantic search
13
Deep Learning for Query understanding
Matching query and item
• Text matching
• Attribute matching
Ranking Items
Neural IREnd-to-end matching and ranking
Image understandingNot just text search
![Page 14: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/14.jpg)
Outline
14
• Core problems of e-commerce search
• Semantic search in e-commerce
• Deep Learning for semantic search– Query classification– Query token tagging– Neural IR– Image understanding (sneak peek)
![Page 15: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/15.jpg)
Query Classification
15
Text query
product type 1 : confidence levelproduct type 2 : confidence levelproduct type 3 : confidence level
Product Type
• A predefined list
• Indicates a specific product in the catalog
• Every item in the catalog is tagged with a product type
![Page 16: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/16.jpg)
Query classification examples
16
Computer Video Cards : 0.85Laptop Computers: 0.08Desktop Computers: 0.06
nvidia gpu
Food Storage Bags: 1.0ziploc bags
Large number of product typesbedroom furniture
Hard to balance precision vs recall
![Page 17: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/17.jpg)
Query classification challenges
17
Short text
• Queries are of 2-3 tokens
Large scale classification
• Thousands of product types (classes)
Multi-class, multi-label problem
• Same query can have multiple product types
Needs to respond in few milliseconds
• Classifies queries at runtime
Unbalanced class distribution
• Some product types are much more popular
![Page 18: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/18.jpg)
Data and Model
18
BiLSTM
<query, product type ordered>
<query, item ordered>
Historical Search Log
https://guillaumegenthial.github.io/sequence-tagging-with-tensorflow.html
Output Layer
word2vec
Softmax/sigmoid
![Page 19: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/19.jpg)
Usage of query classification
19
Without Query Classification After we understand the query “lemon” as a fruit
lemon
20% reduction of irrelevant items in certain query segments
![Page 20: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/20.jpg)
Key Learnings
20
Logistic RegressionDeep
Learning
6% higher
accuracy
CNN
BiLSTM
More accurate
1 K80 GPU
8 Core CPU
6X faster
1 K80 GPU48 Core CPU
Equal
Accuracy Training Time
![Page 21: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/21.jpg)
Key Learnings - instability in Prediction
21
Television Stands : 0.32; Laptop Computers : 0.27 Hard Drives : 0.11
Hard Drives : 1.00
Old model
New model
samsung 850 evo 250gb 2.5 inch
![Page 22: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/22.jpg)
Instability in Prediction
22
Training data N Training data (N + 1)2.5% difference in training data
Model N Model (N + 1)
Top predicted class is different for 10% of the test set
![Page 23: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/23.jpg)
Instability in prediction – different seeds
23
Training data N
Model N Model N’
Top predicted class is different for 7% of the test set
Seed 1 Seed 2
Different tensorflowand numpy seeds
![Page 24: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/24.jpg)
Sources of Instability
24
Overfitting
•Deep Learning model has high variance, particularly on the low traffic queries
•Simpler models could be more stable but less accurate
Sigmoid (1-vs-all) classifier is more unstable
•Softmax scores are interdependent across classes and less stable
Noisy training data
• Item order data is less noisy than click
Rounding errors in the arithmetic operations
•CPU is more stable than GPU
![Page 25: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/25.jpg)
Reduction of Instability
25
40% reduction of instability
Softmax
Clicks
CNN
Sigmoid
Orders
BiLSTM
![Page 26: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/26.jpg)
• Product Type• Brand• Color• Gender• Age Group• Size (value & unit)– Pack Size– Screen Size– Shoe Size– …
• Character• Style• Material• …
Attributes to match
26
Not Feasible – Separate classifier for each attribute
• Too many classes (e.g. 100K+ brand values)
• Sparse attributes; most attribute prediction should be NA
• Creating training data of <query, attribute> is more noisy and inaccurate
![Page 27: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/27.jpg)
Query token tagging
27
QueryQuery tokens tagged with Attribute Names
faded glory long sleeve shirts for women
Faded Glory
Long sleeve
shirts
women
for
Product type
Brand
Sleeve length
Gender
NULL
![Page 28: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/28.jpg)
Training data
28
blue women levis jeans
Brand Product Type
GenderColor
toys for girls 3 – 6 years
AgeValue
AgeUnit
GenderProductType
Human curated data
It is a hard task for human
• Is "outside” a product type token in the query, “canopy tents for outside”?
Disagreement between taggers are high (~30%)
Fortunately 10K training data is a good start
![Page 29: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/29.jpg)
Model – BiLSTM-CRF
29
word2vec
Features for CRF
https://guillaumegenthial.github.io/sequence-tagging-with-tensorflow.html
Linear Chain CRF
query tokens
𝑃(𝑡𝑎𝑔1, … , 𝑡𝑎𝑔𝑛)
Char embedding
![Page 30: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/30.jpg)
Char Embeddings
30
G P U
word2vec
BiLSTM-CRF Network
Character embedding network
word2vec type learnt on character sequence
![Page 31: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/31.jpg)
• Maps a sequence of characters to a fixed size vector
• Handles out of vocabulary words
• Handles misspellings
Char Embedding
31
sansung tvsansung tv
Brand Product Type
NULL Product Type
With Char EmbeddingWithout Char Embedding
![Page 32: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/32.jpg)
Improving search results using query tagging
32
Women citizen eco drive watch
Before After understanding the Gender token
Regex match will be incorrect for queries like
pioneer women dinnerware
wonder women bedding
spider man car seats
![Page 33: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/33.jpg)
Other use cases of query tagging
33
samsung tv 32 in
32 in vizio tv
sanyo flat screen tv
led tv sony 55”
samsung tv stand
sony tv remote
TV queries
NotTV queries
Customer Demand Analysis
• Most searched brand of TV
Attribute filter suggestion
• Suggest top attributes (e.g. brand, screen size) that customers look for for in a product type query (e.g. TV)Search query log
![Page 34: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/34.jpg)
Traditional IR
Semantic Search
Neural IR
Neural IR
34
Token and synonym matchLearning to Rank
• Attribute extraction• Token, synonym and
attribute match• Learning to rank
End-to-end matching and ranking
![Page 35: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/35.jpg)
Neural IR – Design 1
35
Query
Item Title
Input Embedding
ConcatenationNeural
Transformation
Transformedfeature
RelevanceScore
• Runtime computation• Not scalable for large
number of items
![Page 36: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/36.jpg)
Neural IR – Design 2
36
Query
ItemTitle
Input Embedding
Neural Transformation
Query, itemembeddings
RelevanceScore
item embeddings can be computed offline and indexed
shared weights
![Page 37: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/37.jpg)
Input Embedding
37
Comparable Accuracy
Input Embedding
token 1
…
token n
Query or
Item Title… AVG
word2vec
token 1
…
token n
… CNN
word2vecInput
Embedding
Query or
Item Title
![Page 38: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/38.jpg)
Training Data
38
query, item title, click through rate (ctr)*
Historical search log
*Position bias correction for ctr of a query, item pair
𝑐𝑡𝑟 =σ𝑟 𝑐𝑙𝑖𝑐𝑘𝑠_𝑐𝑜𝑟𝑟𝑒𝑐𝑡𝑒𝑑𝑟σ𝑟 𝑖𝑚𝑝𝑟𝑒𝑠𝑠𝑖𝑜𝑛𝑠𝑟
𝑐𝑙𝑖𝑐𝑘𝑠_𝑐𝑜𝑟𝑟𝑒𝑐𝑡𝑒𝑑𝑟 = 𝑐𝑙𝑖𝑐𝑘𝑠𝑟 + 𝑖𝑚𝑝𝑟𝑒𝑠𝑠𝑖𝑜𝑛𝑠𝑟 − 𝑐𝑙𝑖𝑐𝑘𝑠𝑟 ∗ 𝑃 𝑐𝑙𝑖𝑐𝑘 𝑟)
𝑟 = 𝑟𝑎𝑛𝑘 𝑎𝑡 𝑤ℎ𝑖𝑐ℎ 𝑡ℎ𝑒 𝑖𝑡𝑒𝑚 𝑤𝑎𝑠 𝑑𝑖𝑠𝑝𝑙𝑎𝑦𝑒𝑑
![Page 39: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/39.jpg)
Training Loss
39
Point-wise Pair-wise
𝑥𝑞 = 𝑞𝑢𝑒𝑟𝑦 𝑓𝑒𝑎𝑡𝑢𝑟𝑒𝑠
𝑥𝑝 = 𝑖𝑡𝑒𝑚 𝑓𝑒𝑎𝑡𝑢𝑟𝑒𝑠
𝑓 𝑥𝑞, 𝑥𝑝 → ctr
Regression problemSigmoid cross entropy loss
Brooks shoes
𝑥𝑞 𝑥𝑝 𝑥𝑛
relevant less relevantquery
𝑓 𝑥𝑞, 𝑥𝑝 > 𝑓 𝑥𝑞, 𝑥𝑛𝑤ℎ𝑒𝑛 𝑐𝑡𝑟 𝑥𝑞, 𝑥𝑝 > 𝑐𝑡𝑟(𝑥𝑞, 𝑥𝑛)
Minimize pair inversionsPair-wise logistic loss
![Page 40: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/40.jpg)
Accuracy on pair-wise loss
40
NDCG captures quality of overall rankingPair accuracy captures if higher ctr (relevant) items ranked above the lower ctr items
0.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
70.00%
Design 1 Design 2
NDCG@10 lift against baseline
30.00%
31.00%
32.00%
33.00%
34.00%
35.00%
36.00%
Design 1 Design 2
Pair Accuracy lift against baseline
![Page 41: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/41.jpg)
Pros
• End to end approach
• Enables Semantic matching implicitly
• Handles different data types (text, image)
Cons
• Not scalable (yet)
• Not so successful (yet)
Neural IR
41
![Page 42: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/42.jpg)
Image understanding
42
Predicted Attributes• Product type• Style• Material• Color
Attribute Prediction
Visual Search
CompatibleOutfit
![Page 43: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/43.jpg)
Image understanding key learnings
43
• Multi-task learning is more accurate
• Predicting style is harder than predicting product type
Attribute Prediction
Visual Search
CompatibleOutfit
• A/B test on hayneedle.com
• Comparable results against a well established startup
• Under exploration
• Early results beating token based approach
![Page 44: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/44.jpg)
Future
44
Evolution of mobile phone
![Page 45: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/45.jpg)
Future
45
Web Search E-commerce Search
Conversational commerce
Seamless search and personalized results
V-Commerce
![Page 46: Deep Learning for Semantic Search in E-commerce...Query classification challenges 17 Short text •Queries are of 2-3 tokens Large scale classification ... CNN BiLSTM More accurate](https://reader033.fdocuments.net/reader033/viewer/2022060815/6094321252f99e7a023646e3/html5/thumbnails/46.jpg)
46