Visual search is a familiar experience in our daily lives since we are exposed to multiple objects, and we also search with others such as searching during shopping. Previous studies have suggested that when people act together, they spontaneously take a partner’s task into account and form memories of the self’s task-related object as well as the partner’s task-related object (i.e., the joint memory effect; Eskenazi et al., 2013). However, most of these findings have been examined under the cases which required two persons to simultaneously attend to one object and did not reflect search scenarios. We therefore investigated whether the joint memory effect depended on this simultaneous attending and whether it also facilitated a subsequent search for each other’s target on their behalf. In this study, participant pairs searched for different targets in parallel and were repeatedly presented with the same search layouts. It can form associative memory with the target location, which shortens search time. Subsequently, a surprise recognition test was conducted in Experiment 1, and the joint memory effect was observed. In Experiments 2a and 2b, the recognition test was replaced with the transfer search, where one participant from each pair searched what the partner had searched and the other searched what nobody had searched. Search time did not differ within the pairs. These results suggest that the joint memory effect does not need simultaneous attending to form similar memories between the two persons. However, it may not necessarily serve future search.