Where is the implementation of self.send of RaftRouter?

lyy4j · May 30, 2021, 6:34am

When I read the source code of the implements of raftstore, I cannot find the implements of method self.send which invoked at

github.com

tikv/tikv/blob/06c3e76eab84482d49a36d634fb2a6c05995f54b/components/raftstore/src/store/fsm/store.rs#L270


        _ => unreachable!(),
    }
}


#[inline]
pub fn send_raft_command(
    &self,
    cmd: RaftCommand<EK::Snapshot>,
) -> std::result::Result<(), TrySendError<RaftCommand<EK::Snapshot>>> {
    let region_id = cmd.request.get_header().get_region_id();
    match self.send(region_id, PeerMsg::RaftCommand(cmd)) {
        Ok(()) => Ok(()),
        Err(TrySendError::Full(PeerMsg::RaftCommand(cmd))) => Err(TrySendError::Full(cmd)),
        Err(TrySendError::Disconnected(PeerMsg::RaftCommand(cmd))) => {
            Err(TrySendError::Disconnected(cmd))
        }
        _ => unreachable!(),
    }
}


fn report_unreachable(&self, store_id: u64) {

Could you give some insights behind this function chain?

tison · May 30, 2021, 6:51am

Hi @lyy4j ! Glad to see the question.

I’ve updated the description for you for better expression. Correct me if I get it wrong.

For the very question, I think self.send is implemented as

github.com

tikv/tikv/blob/06c3e76eab84482d49a36d634fb2a6c05995f54b/components/batch-system/src/router.rs#L232


    });
    match res {
        CheckDoResult::Valid(r) => Either::Left(r),
        CheckDoResult::Invalid => Either::Left(Err(TrySendError::Disconnected(msg.unwrap()))),
        CheckDoResult::NotExist => Either::Right(msg.unwrap()),
    }
}


/// Send the message to specified address.
#[inline]
pub fn send(&self, addr: u64, msg: N::Message) -> Result<(), TrySendError<N::Message>> {
    match self.try_send(addr, msg) {
        Either::Left(res) => res,
        Either::Right(m) => Err(TrySendError::Disconnected(m)),
    }
}


/// Force sending message to specified address despite the capacity
/// limit of mailbox.
#[inline]
pub fn force_send(&self, addr: u64, msg: N::Message) -> Result<(), SendError<N::Message>> {

… may be @BusyJay could give more background.

lyy4j · May 30, 2021, 10:56am

thanks for you answer. From my own experience，the function of “pub fn send(&self, addr: u64, msg: N::Message)” owned by BatchRouter，and BatchRouter is the attribute of the RaftRouter, and I can not find the "impl BatchRouter(Router) for RaftRouter ", so I have doubts。

lyy4j · May 31, 2021, 2:03am

oh, i ignore the “impl<EK, ER> Deref for RaftRouter<EK, ER>” ,thanks