Cross-Stitch Network
Tags: #machine learning #multi taskEquation
$$\begin{bmatrix} \tilde{x}^{ij}_{A}\\\tilde{x}^{ij}_{B}\end{bmatrix}=\begin{bmatrix} a_{AA} & a_{AB}\\ a_{BA} & a_{BB} \end{bmatrix}\begin{bmatrix} x^{ij}_{A}\\ x^{ij}_{B} \end{bmatrix}$$Latex Code
\begin{bmatrix} \tilde{x}^{ij}_{A}\\\tilde{x}^{ij}_{B}\end{bmatrix}=\begin{bmatrix} a_{AA} & a_{AB}\\ a_{BA} & a_{BB} \end{bmatrix}\begin{bmatrix} x^{ij}_{A}\\ x^{ij}_{B} \end{bmatrix}
Have Fun
Let's Vote for the Most Difficult Equation!
Introduction
Equation
Latex Code
\begin{bmatrix} \tilde{x}^{ij}_{A}\\\tilde{x}^{ij}_{B}\end{bmatrix}=\begin{bmatrix} a_{AA} & a_{AB}\\ a_{BA} & a_{BB} \end{bmatrix}\begin{bmatrix} x^{ij}_{A}\\ x^{ij}_{B} \end{bmatrix}
Explanation
The cross-stitch unit takes two activation maps xA and xB from previous layer and learns a linear combination of two inputs from previous tasks and combine them into two new representation. The linear combination is controlled by parameter \alpha.
Related Documents
- See below link of paper Cross-stitch Networks for Multi-task Learning for more details.
Related Videos
Discussion
Comment to Make Wishes Come True
Leave your wishes (e.g. Passing Exams) in the comments and earn as many upvotes as possible to make your wishes come true
-
Kathy YoungHere goes everything, I aim to pass this exam.Elliot Stone reply to Kathy YoungBest Wishes.2023-03-29 00:00:00.0 -
Harold BrooksCan't wait to pass this test and move forward.Eric Gonzalez reply to Harold BrooksBest Wishes.2023-12-16 00:00:00.0 -
Phyllis CollinsDoing everything I can to ensure I pass this exam.Mildred Turner reply to Phyllis CollinsBest Wishes.2023-12-26 00:00:00.0
Reply